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(54) DEVICE, METHOD, AND MEDIUM FOR GENERATING GRAPHIC DATA 



(57) The present invention relates to a POI (point of 
interest) operation for moving an object corresponding 
to a selected node to the center of an editing window as 
pre-processing for changing the viewpoint of an object 
displayed in three-dimensional virtual space in a win- 
dow of a display device. A node displayed in a pop-up 
menu in a first window is selected by a mouse 262. A 
model editing tool 420 displays an object corresponding 
to the selected node in a second window. After a confir- 
mation operation by the user by the mouse 262, the 
model editing tool 420 preferably enlarges and moves 
the display of the object to the center of the second win- 
dow. Next, when the user selects a "Rotate". "Move", 
"Scale", or other operation mode in the "Conductor" 
window by the mouse and draws on or dicks the inside 
of the display screen by the mouse 262. the model edit- 
ing tool 420 rotates, moves, or enlarges the image of the 
object in accordance with the operation mode of the 
mouse and the operation of the user. As a result, the 
object can be viewed from different viewpoints. 
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Description 

TECHNICAL FIELD 

The present invention relates to a graphic data gen- 
erating apparatus, a graphic data generation method, 
and a medium for the same, more particularly relates to 
a graphic data generating apparatus, a graphic data 
generation method, and a medium for the same able to 
be used for comprehensive editing of a script etc. acti- 
vated in accordance with an operation of a client (user) 
with respect to a shape and position of a three-dimen- 
sional graphic able to be used for expression of an 
object in a tiiree-dimensional virtual space and with 
respect to a displayed three<limensional image. 

Specifically, tiie present invention relates to a 
graphic data generating apparatus, graphic data gener- 
ating method, and medium for the same enable an 
object in three-dimensional virtual space to be viewed 
from different viewpoints, more specifically relates to 
POI (point of interest) technology for automatically mov- 
ing an object to a center of a window at a prior stage to 
enable viewing from a different viewpoint. 

BACKGROUND ART 

As a description language capable of comprehen- 
sive handling tiiree-dimensional information using the 
framework of the WWW (World Wide Web) providing 
various types of information on the Internet, that glo- 
bally constructed computer network, the VRML (virtual 
reality modeling language) has been known. 

First, an explanation will be given of the historical 
background up to the development of the VRML. 

As an information system able to be used on the 
Internet, the WWW developed by tfie Swiss CERN 
(European Center for Nuclear Research) is known. The 
WWW was designed to enable text, images, sound, and 
other multimedia data to be viewed and heard by a 
hyper text format and asynchronously transfers to per- 
sonal computers and other terminal equipment informa- 
tion stored in WWW servers based on protocol called 
HTTP (Hyper Text Transfer Protocol). The WWW is 
basically comprised of servers and browsers. 

A WWW server is comprised of server software 
known as an HTTP daemon and HTML (Hyper Text 
Makeup Language) files storing hyper text information. 
A "daemon" is a program which manages and proc- 
esses information in the background when working on 
UNIX. 

Hyper text information is expressed by a description 
language called the HTML Hyper text is described by 
HTML by tiie expression of the logical structure of sen- 
tences by format designations known as "tags" sur- 
rounded by "<" and ">". Unks with other information are 
described by link information known as "anchors". 
When designating a location of information by anchors, 
a URL (Uniform Resource Locator) is used. 



The protocol for transferring a file described in 
HTML on a TCP/IP (Transmission Control Proto- 
col/Internet Protocol) network is HTTP. HTTP functions 
to send a request for transfer of information from a client 

5 to a WWW server and transfer hyper text information of 
an HTML file to the client. 

A WWW browser is often used as tiie environment 
for uses of tiie WWW. "Browse" means to freely view. A 
browser executes the work for inquiring about informa- 

10 tion to a server in accordance with an operation of a 
user. A WWW browser is Netscape Navigator (trade- 
mark of Netscape Communications Corporation of the 
U.S.) and other client software. It is possible to use a 
WWW browser to browse through files, that is, home 

15 pages, of WWW servers on the globally expanding 
Internet, corresponding to a URL, and possible to suc- 
cessively follow back linked home pages to access var- 
ious sources of information on the WWW - called "net 
surfing". 

20 In recent years, the WWW has further expanded. 
Specifications for description languages for three- 
dimensional graphics, called VRML, have been formu- 
lated enabling description of three-dimensional spaces 
and setting hyper text links for objects drawn by three- 

25 dimensional graphics and enabling successively- 
access of WWW servers while following back the links. 
VRML browsers are being developed for displaying 
tiiree-dimensional spaces described based on such 
VRML specifications. 

30 Details of VRML are described for example in tiie 
reference 'VRML o Shim: 3-Jigen Denno Kukan no 
Kochiku to Buraujingu (Learn About VRML: Building 
and Browsing Three-Dimensional Computer Space)\ 
written by Mark Pesce, translated by Koichi Matsuda. 

35 Terunao Kamachi, Shoichi Takeuchi, Yasuaki Honda, 
Junichi Toshimoto, Masayuki Ishikawa, Ken Miyashita, 
and Kazuhiro Hara, first edition published March 25, 
1996. published by Prentis Hall, ISBN4-93 1356-37-0 
(original work: "VRML: Browsing and Building 

40 Cyberspace", Mark Pesce, 1995 New Readers Publish- 
ing, ISBN 1-56205-498-8) and the reference "VRML no 
Saishin Doko to CyberPassage (Recent Trends in 
VRML and CyberPassage)", Koichi Matsuda and Yas- 
uaki Honda, bit (published by Kyoritsu)/1996. Vol. 28. 

45 No. 7. pp. 29 to 36, No. 8, pp. 57 to 65. No. 9. pp. 29 to 
36, and No. 10. pp. 49 to 58). 

The formal and complete specifications in The Vir- 
tual Reality Modeling Language Version 2.0", ISO/IEC 
CD 14772, August 4, 1996 are disclosed at tiie following 

50 home page address: 

http://www.vrml.org/Specifica- 
tionsA/RML2.0/FINALyspec/ind ex.html 

Tiie Japanese language version is disclosed at ttie 
following home page address: 

55 httpyAAww.webcity.co.jp/info/andoh/vrml2.0/spec 
-jp /index.html 

As a VRML 2.0 browser and shared server soft- 
ware, for example, the present applicant, Sony Corpora- 
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tion, has developed and is marketing "community Place 
(trademark) Browser/Bureau". The p-version (test ver- 
sion) can be downloaded from the Internet home page 
httpV/vs.sony.co. jp). 

In the VRML 2.0. it is possible to describe and 5 
express autonomous behavior of an object in a three- 
dimensional virtual space. When using VRML 2.0 to 
prepare VRML content where an object moves around 
in a three-dimensional virtual space, normally the fol- 
lowing process of work is undergone. Note that below io 
the set of a VRML file, script file, etc. for realizing behav- 
iors of a series of objects in a single virtual space is 
called "VRML content". 

Routine for Preoarina VRML Content is 

The general routine for preparing VRML content is 
described below. 

(1) Preparation of Model 20 

The shape, position, etc. of an object (model) 
arranged in a virtual space are described based on 
VRML 2.0 to prepare a basic VRML file. 

25 

(2) Description of Sensor Node 

TouchSensors generating events in the case of 
click operation by a nnouse (pointing operation) on 
objects in the virtual space, a TimeSensor generating 30 
an event when a predetermined time arrives, and other 
sensor nodes is added to the VRML file. 

(3) Description of Routing 

35 

The description of the routing for transmission of 
events generated in accordance with pointing opera- 
tions with respect to objects to which sensor nodes 
have been added is added to the VRML file. 

40 

(4) Description of Script Node 

The description of a script node for transfer of 
events transmitted by the routing to and from an exter- 
nal script is added to the VRML file. 45 

(5) Preparation of script File 

A script (program) in the Java language (Java is a 
trademark of Sun Microsystems of the U.S.) for realizing so 
predetermined behavior for objects in the virtual space 
based on events transmitted through the script node is 
described to prepare a script file. 

The desired VRML content is prepared by the proc- 
ess of description of the above (1 ) to (5). ss 

When desiring to prepare VRML content accompa- 
nying the autonomous behavior of an object in a virtual 
space based on VRML 2.0, an existing authoring soft- 



ware, called a modeler, for example, 3D Studio Max 
(trademark), or other software is used to prepare the 
shape of the object or animation and output the same in 
the VRML 2.0 format. When the modeler does not sup- 
port the VRML 2.0 format, it is necessary to use a con- 
verter etc. to convert to the VRML 2.0 format. 

Further, descriptions of various sensor nodes etc. 
defined by the VRML 2.0 are added to the VRML file 
using a text editor, scripts in the Java language are pre- 
pared using a text editor, corresponding script nodes 
are added, routes are added, etc. repeatedly. 

Rnally, when confirming the actual operation, a 
VRML browser compatible with VRML 2.0 is activated 
and the behavior of the object is confirmed by a click 
operation by a mouse etc. 

This method of preparing VRML content features 
an extremely large amount of complicated work and 
remarkably poor work efficiency. For example, when 
adding a field to a script node, it is necessary to revise 
both the script file and the VRML file. Further, it is nec- 
essary to maintain a match between the two. 

When designating routing of an event as well, fur- 
ther, it is necessary to ensure a match of the type of the 
event (format of data). If the format of description of the 
event etc. is mistaken, when reading by a VRML 
browser, a composition error will arise and it is neces- 
sary to again revise the file. Further, each time a node is 
added, re-reading by the VRML browser is necessary, 
so the work efficiency is extremely poor. 

Points have been found in the performance of the 
interactive operation in the conventional method which 
should be improved. One example of a defect in the 
interaction is the trouble and inefficiency of the confir- 
mation operation when preparing a world. Figure 1 is a 
fbw chart of the routine of a conventional method of 
preparation of a world. The production of the world is 
classified the two. In the first, the model is produced, 
and in the second, the interaction is produced. Details 
will be discussed later in comparison with embodiments 
of the present invention, but while confirmation is nec- 
essary when preparing a world, in tiie convention 
method of preparation shown in Fig. 1, as illustrated at 
step 108, it is necessary to separately use a VRML 
browser. That is, each time confirming an object in a 
three-dimensional space expressed by a revised VRML 
file, it is necessary to activate a VRML browser and des- 
ignate reading of the revised VRML file or, even when a 
VRML browser has already been activated, to desig- 
nate repeat reading of the revised file. The work effi- 
ciency in preparing the VRML content was therefore 
extremely poor. 

Further, there are cases where it is desired to view 
an object displayed in virtual space from a different 
viewpoint. In the conventional method, the operability 
and functionability were insufficient. In particular, in the 
prior art, there was the disadvantage that it was not pos- 
sible to view an object freely from a different viewpoint 
when the object was positioned at one location of the 
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window. 

DISCLOSURE OF THE INVENTION 

An object of the present invention is to provide a 
graphic data generating method, a graphic data gener- 
ating apparatus for working that graphic data generating 
method, and a medium for mediating a program for exe- 
cution of the graphic data generating method having 
POI (point of interest) technology for automatically mov- 
ing an object in three-dimensional virtual space to a 
center of a window at a prior stage to enable viewing of 
the object displayed in virtual space from a different 
viewpoint. 

Another object of the present invention is to provide 
a graphic data generating apparatus, graphic data gen- 
erating method, and medium for mediating a program 
for executing the graphic data generating method which 
enable an object displayed in virtual space to be viewed 
from different viewpoints by an easy and reliable opera- 
tion method. 

According to a first aspect of the present invention, 
there is provided a graphic data generating apparatus 
comprising a display processing means for displaying 
information in a first window and second window of a 
screen of a display device; selecting means for select- 
ing a node displayed in the first window of the display 
device; and an editing processing means for processing 
to display a graphic of an object corresponding to a 
node selected by the selecting means in the second 
window; the editing processing means selecting an 
object corresponding to a node selected by the select- 
ing means, operating linked with the selecting means to 
display tiiis in the second window, and successively 
moving tiie object coresponding to the selected node to 
predetermined positions of the second window. 

Preferably, the editing processing means and the 
display processing means enlarge to a certain size and 
display the graphic of the object coaesponding to the 
node at the center of tiie second window. 

More preferably, tiie selecting means includes a 
mouse operating linked with the display device. 

Preferably, tiie apparatus further comprises an 
operation instructing means for giving instructions 
(Rotate. Move, Navigate, Scale) so that an object dis- 
played in the second window of the display device can 
be viewed from different viewpoints. Also, after the 
graphic of the selected object is shown moved to a pre- 
determined position of the second window, the editing 
processing means and the display processing means 
display tiie objiect displayed in virtual space in tiie sec- 
ond window of the display device from a different view- 
point in accordance with an operation instruction from 
the operating instructing means. 

Preferably, tiie operation instructing means 
includes an operating means for making the object 
rotate, an operating means for making the object move, 
and a means for changing the size of tiie object. 



Preferably, the means for changing tiie size of tiie 
object has a means for enlarging the size of tiie object 
and/or a means for reducing the size of tiie object. 

Specifically, the operation instructing means has a 
5 Rotate means, Move means. Navigate means, and 
Scale means displayed on tiie screen of tiie display 
device. 

According to a second aspect of the present inven- 
tion, there is provided a graphic data generating method 

10 including tiie steps of: displaying selectable nodes in a 
first window of a display device, attaching a node 
selected by a selecting means for selecting a predeter- 
mined node from nodes displayed in the first window, 
and moving display for displaying an object con-espond- 

15 ing to a received selected node in a second window and 
successively moving it to predetermined positions in the 
second window 

Preferably in the moving display step, a graphic of 
tiie object corresponding to the node is displayed at the 

20 center of the second window enlarged to a predeter- 
mined size. 

Specifically, the selecting means includes a mouse 
operating linked with the display device. 

Preferably after moving the graphic of the selected 

25 object to a predetermined position in the second win- 
dow for the display, the method enables viewing of the 
object displayed in virtual space in the second window 
of the display device from a different viewpoint in 
accordance witii an instruction (Rotate. Move, Navigate, 

30 Scale) of an operation instructing means so that the 
object displayed in the second window of the display 
device can be viewed from different viewpoints. 

Preferably, the operation instruction includes an 
instruction for making the object rotate, an instruction 

35 for making the object nrrove, and an instruction for 
changing the size of tiie object. 

More preferably the instruction for changing ttie 
size of the object includes an instruction for enlarging 
the size of the object or an instruction for reducing the 

40 size of the object. 

According to a third aspect of the present invention, 
there is provided a medium for mediating a program 
executing tiie graphic data generating method. Specifi- 
cally, the medium is a medium for mediating a program 

45 executing a graphic data generating method including 
tiie steps of displaying selectat»le nodes in a first win- 
dow of a display device, attaching a node selected by a 
selecting means for selecting a predetermined node 
from nodes displayed in tiie first window, and moving 

50 display step of displaying an object corresponding to a 
received selected node in a second window and suc- 
cessively moving it to predetermined positions in tiie 
second window. 

Preferably in the moving display step, a graphic of 

55 the object corresponding to the node is displayed at the 
center of the second window enlarged to a predeter- 
mined size. 

More preferably after nrioving the graphic of the 



4 



7 



EP 0 890 926 A1 



8 



selected object to a predetermined position in the sec- 
ond window for the display, the program enables view- 
ing of the object displayed in virtual space in the second 
window of the display device from a different viewpoint 
in accordance with an instruction (Rotate. Move. Navi- 5 
gate, Scale) of an operation instructing means so that 
the object displayed in the second window of the display 
device can be viewed from different viewpoints. 

More preferably, the operation instruction includes 
an instruction for making the object rotate, an instruction 10 
for making the object naove, and an instruction for 
changing the size of the object. 

More preferably, the instruction for changing the 
size of the object includes an instruction for enlarging 
the size of the object or an instruction for reducing the is 
size of the object. 

As explained above, according to the present inven- 
tion, processing for automatically moving an object cor- 
responding to a selected node to a second window in a 
display and then changing the viewpoint when desiring 20 
to view an object from any different viewpoint becomes 
easy. 

BRIEF DESCRIPTION OF THE DRAWINGS 

25 

The above objects and features and other objects 
and features of the present invention will become 
clearer from the following description given with refer- 
ence to the attached drawings, in which: 

30 

Fig. 1 is a flow chart of the method of preparation of 
VRML content; 

Fig. 2 is a view of the configuration of a network 
system comprehensively handling a three-dimen- 
sional virtual space to which a graphic data gener- 35 
ating apparatus of the present invention is applied; 
Fig. 3 is a view of the configuration of a content 
preparation software tool of the present invention; 
Fig. 4 is a flow chart of the method of preparation of 
VRML content executed by the content preparation 40 
software tool illustrated in Fig. 3; 
Fig. 5 is a flow chart illustrating the processing of a 
basic confirmation operation in the process of prep- 
aration of the VRML content illustrated in Fig. 4; 
Fig. 6 is a flow chart illustrating tiie processing of a 45 
suitable confirmation operation in the process of 
preparation of the VRML content illustrated in Fig. 
4; 

Fig. 7 is a view of the configuration of a computer 
system in the network shown in Fig. 2; so 
Fig. 8 is a view of tiie configuration of a content 
preparation software tool according to an embodi- 
ment of the content preparation software tool illus- 
trated in Fig. 3; 

Fig. 9 shows windows displayed by a graphical ss 
interface portion of a content preparation software 
tool of Fig. 8 in a display device in a conputer sys- 
tem; 



Rg. 10A to Fig. 10C are enlarged views of tiie 
CONDUCTOR window illustrated in Fig. 9; 
Rg. 11 is a view of an example of the display of a 
3D VIEW window (editing window) illustrated in Rg. 
9; 

Rg. 12 to Fig. 14 are views of the graphic of POINT 
OF INTEREST in a window of a screen of a display 
device; 

Rg. 15 Is a flow chart of the processing for display- 
ing and setting regions of tiie sensor node; 
Rg. 1 6 and Fig. 1 7 are views of examples of display 
by a PARALLEL VIEW function; 
Rg. 18 to Fig. 22 are views of examples of display 
by an ATTENTION function; 
Rg. 23 is a flow chart of tiie processing of an 
ATTENTION function; 

Rg. 24 is a flow chart of a routing editing process- 
ing; 

Rg. 25 to Fig. 27 are views of examples of display 
in routing editing processing; 
Rg. 28 shows an example of the display of an 
object for preparing VRML content; 
Rg. 29 is a flow chart of the processing for prepar- 
ing first VRML content; 

Rg. 30 to Fig. 34 show examples of the display in a 
window when preparing first VRML content; 
Rg. 35 is a flow chart of the processing for prepar- 
ing second VRML content; 
Rg. 36 and Fig. 37 show examples of the display in 
a window when preparing second VRML content; 
Rg. 38 to Fig. 44 show examples of the display in a 
window when preparing second VRML content; 
Rg. 45 is a flow chart of the processing for prepar- 
ing third VRML content; and 
Rg. 46 to Fig. 49 show examples of the display in a 
window when preparing third VRML content. 

BEST MODE FOR CARRYING OUT THE INVENTION 

Embodiments of the graphic data generating appa- 
ratus, graphic data generating method, and medium for 
mediating a program for executing the graphic data gen- 
erating method will be explained next. 

Network System 

Rgure 2 is a view of the configuration of a network 
system 1 for comprehensively handling a three<limen- 
sional virtual space according to one example of appli- 
cation of tiie graphic data generating apparatus, graphic 
data generating metiiod, and medium of the present 
invention. 

The network system 1 is constituted by an in-house 
network 10, an Internet system 12. an Internet provider 
14. an ISDN (integrated services digital netwak) net 16, 
and a client (subscriber) system 2 connected to each 
other. 

The network system 1 may have a plurality of in- 



EP0890 926 A1 



10 



house networks 10, Internet systemsl 2, internet provid- 
ers 14, client systOTS 2, etc.. but for simplification of 
illustration, in Rg. 2, just one of each of them is illus- 
trated. 

The in-house network 10 is constituted by a hard 
disk drive 100, a server apparatus 102, a LAN (local 
area network) 104, and a gateway server (GWS) 106. 

The Internet system 12 connected to the in-house 
network 10 Is constituted by rout^ devices 120 and 124 
and a digital communications line 122. 

An Internet provider 14 is provided between the 
Internet system 12 and the ISDN net 16. 

In the network system 1 shown in Fig. 2, the in- 
house network 10 and the client (subscriber) system 2 
are connected through the Internet system 1 2, the Inter- 
net provider 14. and the ISDN net 16. In this specifica- 
tion, the LAN 104. Internet system 12. Internet provider 
14. and ISDN net 16 are referred to as the "network". 
This network transfers data between the server appara- 
tus 102 and the client system 2. 

The client system 2 connected to the ISDN net 1 6 is 
constituted by a computer system having a personal 
computer (PC) 20, a display device (DSP) 24, and an 
input device (IN) 26. A storage device 28 is connected 
to the computer system. As the computer system, how- 
ever, while the display device 24. input device 26, and 
external storage device 28 connected to the personal 
computer (PC) 20 constitute part of the computer sys- 
tem, they may be provided externally as well. In the 
present embodiment, the explanation will be made of 
the case where the display device 24 and input device 
26 constitute part of the computer system, while the 
external storage device 28 is provided outside the com- 
puter system. 

Server Apparatus 102 

The server apparatus 102 of the in-house network 
10 is a server apparatus such as the "Community 
Place" (trademark) (for exanrple, httpV/vs. sony.co.jp/) 
which acquires through the network etc. VRML content, 
that is, VRML, content comprised of a VRML file show- 
ing the shape and position of a three-dimensional object 
described by the user by VRML 2.0 and a script file 
described by the user by the Java language or other 
programming language and activated in accordance 
with an operation by the user on the object, stores the 
same in the hard disk drive 100, and manages the 
results of the storage. 

Below, the set of the VRML file (exlension.wri), the 
script file in the Java language (extension .java), etc. will 
be called the VRML content. 

The server device 102 sends the VRML content of 
the three-dimensional virtual space stored in the hard 
disk drive 1 00 to the client system 2 via the server appa- 
ratus 102. LAN 104, Internet system 12, Internet pro- 
vider 14, and ISDN net 16 (hereinafter these 
communication nodes in the network system 1 will be 



also simply referred to all together as the "network^ and 
displays the same on the display device 24. 

Further, the server apparatus 102, in response to a 
reguest of the client system 2, transfers a content prep- 

5 aration software tool, that is, a program, stored in for 
example the hard disk drive 100 through the network to 
the client system 2. Alternatively, it may distribute a con- 
tent preparation software tool, that is. a program, to the 
client system 2 in a state stored in a floppy disk 280 or a 

10 magneto-optic disk 282. 

Explanation of Medium for Prooram 

As the graphic data generation apparatus, graphic 

15 data generation method, and medium for the program 
for executing tiie method of tiie present invention, the 
following explanation will be made mainly of the config- 
uration and operation at the client system 2, but the 
"medium" in the present invention not only includes a 

20 recording medium storing a computer program for real- 
izing the graphic data generation method of tiie present 
invention, but does not merely mean a program storing 
medium and also means a program transmission 
medium when downloading to the client (subscriber) 

25 system 2 described in detail in the following embodi- 
ments a computer program through the network system 
1 of Rg. 2 for the client system 2 to realize tiie graphic 
data generation mettiod of the present invention. The 
reason is that as clear from the following explanation. 

30 when working tiie graphic data generation method of 
tiie present invention, it is possible to realize certain 
processing at any location witiiout the restrictions of 
concentration. The present invention can be also real- 
ized by a localization. 

35 Figure 3 is a view of a graphic data generation 
metiiod and graphic data generation apparatus, in par- 
ticular a content preparation software tool 3 (Commu- 
nity Place (trademark) Conductor), of the present 
invention in a client (subscriber) system 2. The content 

40 preparation software tool 3 has a graphical user inter- 
face (GUI) 31, object manager 32, Java compiler 33, 
scene graph manager 34, Java VM 34B, purser 34C, 
HTML browser 35. and backup manager 36. 

The graphical user interface portion 31 performs a 

45 variety of window displays. 

The Java compiler 33. an external program, com- 
piles Java programs. The scene graph manager 34 is a 
portion common with the browser. The scene graph 
manager 34A handles tiie hierarchical structure of the 

50 VRML nodes. The purser 34C analyzes the VRML file. 
The Java VM34B executes tiie saipt described by Java. 

The HTML browser 35, an external program, is 
used for displaying an anchor node or displaying a help 
file of a VRML node described by the HTML format. 

55 The portion 34 comprised of tiie scene graph man- 
ager 34A, Java VM 34B, and purser 34C may be used 
together with for example the Community Place (trade- 
mark) browser provided by Sony Corporation. 
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The backup manager 36 is enabled when the TIa/* 
button on the screen of the display device is depressed 
by a mouse to enter the "Play" mode and starts prepa- 
rations for backup of the field values. The stored field 
values are successively reproduced to restore the origi- 
nal screen when the "Stop" button is depressed. That is, 
the "Conductor" content preparation software tool is 
designed to enable everything from editing of the world 
to confirmation of operation. When the "Play" mode is 
entered by the user depressing the "Play" button. Con- 
ductor starts emulation of a browser. In this state, the 
states of the fields change, for example, an object starts 
to move, in accordance with interaction from the user. 
When however the "Stop" button on the screen of the 
display de\^ice Is depressed by the mouse to return to 
the "normal editing mode", it is necessary to return 
completely to the "state before depressing the Play" but- 
ton. What are necessary at this time are backup of the 
field values and processing for their restoration. 

The backup manager 36 operates as follows. The 
backup manager 36 is enabled and starts preparation 
for backup of the field values when the "Play" mode is 
entered. When the field values are changed for the first 
time due to changes in a moving object etc., the original 
field values are stored. The field values are stored by 
the system of successively stacking them (stack sys- 
tem). When the "Stop" button is depressed, the stored 
values are successively reproduced (the stack is 
popped) to restore the state of display of the original 
window. 

Like when dividing a file into a plurality of files when 
preparing a large sized program, it Is preferable to 
divide a file into a plurality of files when a world has 
become large to a certain extent. The object manager 
32 is the portion for managing the consistency in such a 
case. 

The route editor (not shown) is used when defining 
an event between fields using a route text. In the 
present invention, a node is designated using the GUI 
31, so there is no longer mistaken designation of 
names. Further, even if the user changes the nodes for 
a route, the route text can be automatically updated 
without error while the object manager 32 manages the 
DEF for each scope. 

Script is used to make a more interactive world 
using Java and other languages, txit script is known to 
be difficult to prepare due to the preparation of content. 
In particular, the portion connecting the Java language 
and VRML is difficult. In the present invention, to solve 
this problem, a Script Expert (not shown), explained in 
detail later, is provided. 

Figure 4 is a flow chart of the processing by the 
content preparation software tool 3. In the present 
invention, the defects of the above mentioned prior art 
are solved by omitting the manual work and using a GUI 
31 to enable the work to be efficiently and automatically 
performed in whole tools. This will be explained briefly 
below As explained above, the content preparation soft- 



ware tool 3 illustrated in Fig. 3 can execute any of the 
tasks at any portion of the network 1 . but in the follow- 
ing, for simplification of the explanation, the case of exe- 
cution mainly in the client system 2 will be explained. 

5 The substance of the processing of Fig. 4 will be 
explained first. The processing of the content prepara- 
tion software tool 3 may be roughly divided into (1) ini- 
tialization, (2) preparation of a model, and (3) 
preparation of interaction. 

10 At step 20 1 , for example, model data is downloaded 
from the hard disk drive 100 to the hard disk drive 214 
of the computer system 20. That is. a model described 
in VRML 2.0 is loaded in the computer system 20 of the 
client system 2. As the method of loading, it is possible 

15 to download the data from any portion of the network 
system 1 to the computer system 20. 

At step 202. the model (object) is edited, for exam- 
ple, the model is rearranged, the attributes are 
changed, or other editing is performed. 

20 At steps 203 to 207, the interaction is prepared. 
That is, at step 203, sensors are added, at step 204. a 
script node is added, at step 205, Java programs are 
compiled, and at step 207. routing is edited. 

At step 208. the operation of the results of the 

25 above processing is confirmed by depressing the "Play" 
button shown in the "Conductor" window (Fig. 1 0) of the 
screen of the display device by a mouse. The confirma- 
tion operation explained referring to Fig. 1 is performed 
by activating a browser after the end of the preparation 

30 of the VRML content. The operation of step 208 is pos- 
sible at any time without activating the browser. Details 
will be given later with reference to Fig. 5 to Fig. 6. but 
according to the method of the present invention, that is. 
the content preparation software tool 3, if the user 

35 depresses the "Play" button, the editing saeen, which is 
the "3D Perspective View" window (editing window) 
shown in Fig. 9 etc.. that is. is displayed as it is as the 
substance of the prepared content Instead of the display 
screen of the VRML browser. 

40 Further, the addition of sensors, editing of routing, 
etc. may be performed by interactive operation by a 
graphical user interface (GUI) 31 in the content prepara- 
tion software tool 3 of the present embodiment. 

The content preparation software tool 3 is given the 

45 additional function called a Script Expert which pre- 
pares a template of a script by Interactive operation and 
automatically compiles files when the user confirms the 
operation by an operation. Therefore, the content prep- 
aration software tool of the present embodiment is given 

50 the additional function of automatic compilation at the 
time of confirmation of operation. As a result, the con- 
tent preparation software tool 3 of the present embodi- 
ment eliminates the need for performing this work by 
input of a character string of commands (command 

55 line). By these functions, it is possible to greatly shorten 
the time for the user to prepare content of the three- 
dimensional virtual space by VRML 2.0. 

In the present Invention, the addition of sensors at 
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Step 203 can be simply performed by a drag and drop 
operation. 

Further, in the present invention, the editing of the 
routing at step 207 can be simply performed using a 
GUI. 

Further, In the present invention, there is a function 
of checking the type of the event even when adding a 
route using the route editor and therefore it is possible to 
prevent the user from designating a mistaken route. 

In particular, In the present invention, to overcome 
the disadvantages explained with reference to Fig. 1 . as 
step 208. as explained above and as illustrated in Fig. 5. 
at any timing and without activating the browser, (1) 
S21 1 : when the Tlay" button provided in the screen of 
the display device is depressed by the user as the pre- 
determined first operation. (2) S212: the emulator is 
activated and it is made possible to confirm the opera- 
tion at that time by the operation of the emulator. (3) 
S213: After the confirmation, when the "Stop" button 
provided in the screen of the display device is 
depressed by the user as the predetermined second 
operation, the normal editing mode Is returned to. Due 
to this, when adding nodes or making changes in pro- 
grams for the script nodes simultaneously with normal 
preparation of VRML content, it is possible to use the 
browser emulator and simply confirm the operation on 
the spot by just depressing the "Play" button. If a compi- 
lation error occurs as a result, it is possible to easily 
detect the error, immediately correct the error, and re- 
compile the files. 

In the above confirmation operation, preferat»ly the 
backup manager 36 is made to operate linked with the 
browser emulator. That is, during the confirmation oper- 
ation of step 208. as illustrated in Fig. 6, (1) S221 : when 
the user depresses the "Play" button as the first prede- 
termined operation, (2) S222: the browser emulator 
operates in the same way as above and the backup 
manager 36 is enabled and can perform backup. (3) 
S223: In this state, when for example a moving object 
starting to move by being clicked is clicked. (4) S224: 
the backup manager 36 successively stores the field 
values defining the behavior of motion of the object. (5) 
S225: If the user depresses the "Stop" button as the 
second predetermined operation, the confirmation 
operation ends, but (6) S226: the backup manager 36 
successively restores the stored field values and resets 
the field values of the initial state. This enables restora- 
tion of the object in the original state before the confir- 
mation operation. These operations may be achieved by 
just operation of the "Play" button and "Stop" button, 
therefore in addition to the improvement of the operabll- 
ity, the processing time can also be shbrtened. 

Client (Subscriber) System 2 and Computer System 20 

Figure 7 is a view of the configuration of the compu- 
ter system 20 shown in Fig. 2. In Fig. 7, the external 
storage device 28 illustrated in Fig. 2 is illustrated in 



detail as the floppy disk (FD) 280 and/or magneto-opti- 
cal (MO) disk 282, while the input device 26 is illustrated 
as a keyboard (KB) 260 and/or mouse 262. 

In working the invention, the display device 24 may 

5 be any color display device suitable for interactive infor- 
mation display and processing linked with a keyt)oard, 
mouse, or other data input means, for example, a color 
CRT display device or color liquid crystal display device. 
Below, in the specification, as the "display device 24", 

10 the explanation will refer to the case of a color CRT dis- 
play device or color liquid crystal display device operat- 
ing linked with a keyboard, mouse, or other data input 
means. 

The computer system 20 is for example a computer 

15 designed for multi-media operations and having a com- 
munication function connected to for example tiie ISDN 
net 16. It is constituted by a CPU 202. a ROM 204, an 
input interface (IN l/F) 208. a display device 24 control- 
ler (DSP-C) 210, a video signal recording RAM (VRAM) 

20 212. a hard disk drive (HDD) 214, a floppy disk drive 
(FDD) 216, an MO disk drive 218. and a line interface 
220 connected via a bus 200. 

The CPU 202 performs various operations 
explained below by operating various control programs 

25 Stored in the ROM 204 and HDD 214. For example, the 
CPU 202 displays various image data on the display 
device 24 through the DSP-C 21 0 and receives as input 
the data from the KB 260 or data from the mouse 262 
through tiie input interface 208. The CPU 202 stores tiie 

30 data In a floppy disk 280 serving as the external storage 
device 28 through the floppy disk drive 216 or reads 
data from the FD 280 or else stores the data in an MO 
disk 282 serving as the external storage device 28 
through tiie MO disk drive 218 or reads data from the 

35 MO disk 282. The CPU 202 also communicates with tiie 
ISDN net 16 through tiie line interface 220. 

The computer system 20 displays on the display 
device 24 the image of VRML content of tiie tiiree- 
dimensional virtual space sent from the sender appara- 

40 tus 102 tiirough ttie network including the ISDN 16 to 
display it to tiie user (client). 

The computer system 20 installs tiie content prepa- 
ration software tool 3 supplied from the server appara- 
tus 102 via the network or tiie external storage device 

45 28 in tiie hard disk drive 21 4, activates the content prep- 
aration software tool 3 in accordance with an operation 
of the client using the KB 260 or mouse 262 to prepare 
tiie VRML content of the three-dimensional virtual 
space, stores this in the hard disk drive 214, or uploads 

50 tilis via ttie network or the external storage device 28 
(floppy disk 280 and/or MO disk 282) to the server 
apparatus 102. 

Further, the computer system 20 changes tiie dis- 
played color of an object pointed to or changes the sub- 

55 stance of the display of tiie object in tiie three- 
dimensional virtual space in accordance witii a pointing 
operation by the user using the input device 26 to an 
object displayed on the display device 24. 
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Display of Three-Dimensional Virtual Space: 

According to the client system 2 having a computer sys- 
tem 20, since it is possible to change the substance of 
the display in the display device 24 interactively in s 
accordance with the operation of the user on an object 
in a three-dimensional virtual space, if the client system 
2 is used, it is possible to create a realistic feeling 
where, like reality, the user itself makes the object move 
or touches the object to operate it and make it move or io 
make a sound in a three<limensional virtual space. 

Further, the server apparatus 102 obtaining the 
VRML content of the three-dimensional virtual space 
from a client system 2 through the network stores the 
VRML content in the hard disk drive 100 and can dis- is 
close it to the subsaibers of the Internet through the 
Internet system 12. When being accessed from a client 
system 2 through the networK the server apparatus 102 
transfers the VRML content to the client system 2 
through the network. 20 

The computer system 20 of the client system 2 dis- 
plays the three-dimensional virtual space based on the 
VRML content sent from the server apparatus 102 on 
the display device 24 by a browser. 

When pr^ring VRML content of three-dimen- 25 
sional virtual space closed in the client system 2 and not 
sharing the VRML content of the three<iimensional vir- 
tual space with other users, it is sufficient to display the 
prepared VRML content as it is on the display device 24 
by using the browser. It is not always necessary to 30 
transmit the prepared VRML content to the server appa- 
ratus 102. 

Interaction Display: The user uses the mouse 262 
to point to a desired position on the screen displayed on 
the display device 24 to input operation data for moving 35 
an object in a three-dimensional virtual space or opera- 
tion input data for designating an object in a three- 
dimensional virtual space. The computer system 20 
modifies the content of the three-dimensional virtual 
space in accordance with the operation data and uses 40 
the VRML browser to display the same on the display 
device 24. 

Preferred Embodiments 

45 

Below, an explanation will be made of preferred 
embodiments of the present invention. 

As explained above, in the past, interaction prepa- 
ration work such as the addition of a sensor to the 
graphic data (VMRL file) of an object and routing was so 
manually carried out by the user (client) using the text 
editor function, so careless mistakes easily occur. Fur- 
ther, it cannot be learned whether or not the result of the 
interaction preparation work is correct until the confir- 
mation using the VRML browser shown at step 108 in ss 
Fig. 1, therefore it is necessary to activate the VRML 
browser for confirmation whenever modifying the inter- 
action program, so the work efficiency is low and time is 
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taken. This emt)odiment of the present invention was 
made so as to link up the operation of the model prepa- 
ration and the operation of the interaction preparation 
editor so as to be able to comprehensively perform this 
work and so as to be able to perform the preparation 
work of content in the three-dimensional virtual space 
with a high efficiency and easily in a short time. 

Rgure 8 is a view of the configuration of the content 
preparation software tool 4 shown as an embodiment of 
the content preparation software tool 3 illustrated in Rg. 
3. To perform the model preparation work and the inter- 
action preparation work conriprehensively and linked 
with each other, the content preparation software tool 4 
comprises a graphical user interface (GUI) 40, an edit- 
ing tool 42, a scene graph data base (SGDB) 44, a 
working tool 46, a script preparation unit 47, and a 
VRML browser 308. 

The editing tool 42 is constituted by a model editing 
tool 420, a routing editing tool 422, a scene graph edit- 
ing tool 424, a text editor 426, and a template prepara- 
tion tool 428. 

The working tool 46 is constituted by a browser 
emulator 460, a file input/output unit 462, a file scope 
management unit 464, and a backup restore unit 466. 

The script preparation unit 47 is constituted by a 
Java emulator 470, a Java debugger 472, and a Java 
compiler 474. 

The content preparation software tool 4 is for exam- 
ple stored in a hard disk drive 100 and input through the 
network system 1 or is stored in the network or an exter- 
nal storage device 28 (floppy disk 280 or MO disk 282) 
and input from the external storage device 28 to the 
computer system 20 and installed and used in tiie hard 
disk drive 214. That is, in the present embodiment, tiie 
example is explained of the case where the content 
preparation software tool 4 is realized in the computer 
system 20. 

The constituent parts of the content preparation 
software tool 4 will be explained below. 

Graphical User Interface (GUn 40 

The graphical user Interface (GUI) 40 corresponds 
to the graphical user interface (GUI) 31 of Fig. 3 and dis- 
plays an image used for the input of various data used 
for the preparation of VRML content of tiie three-dimen- 
sional virtual space tiirough tiie PC 20 on the display 
device 24 in the form of a window. 

Rgure 9 is a view of a GUI screen of a first embod- 
iment displayed by tiie GUI 40 on the display device 24. 
The GUI screen illustrated in Fig. 9 has a "Conductor" 
window, "3D Perspective View" window, "Parallel View" 
window, "Resource Library" window, "Scene Graph" 
window, "World Into" window, "Appearance" window, 
"Route" window, "Attribute" window, "Script Expert" win- 
dow (not shown), and "Script Editor" window. 

(1) The "Conductor" window is used for manage- 
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mertt of the Conductor as a whole. 

(2) The "30 perspective View" wirtdow is the portion 
for displaying an image three-dlmensionally. In the 
fbllowing. the word is simplified as "30 window" for 
convenience. 5 

(3) The "Parallel View" window is the portion for dis- 
playing an image by a parallel projection. 

(4) The "Resource Library" window Is the portion for 
managing the library. 

(5) The "Scene Graph" window is the portion for 
displaying the hierarchical tree structure of worlds. 

(6) The "World Info" window is the portion for setting 
the attributes of a world. 

(7) The "Appearance" window is the portion for set- 
ting the color and texture of an object. 

(8) The "Route" window is the portion for routing an 
event. 

(9) The "Attribute" window is the portion for setting 
the attributes of the node and the name of the node. 

(10) The "Script Expert" window is the portion for 
preparing a template of a script. 

(11) The "Script Editor" window is the portion of the 
text editor for editing a Java file. 

Figure 10A Is an enlarged view of the illustrated 
"Conductor" window, and Fig. 10B and Fig. IOC are 
enlarged views of Fig. IDA. The "Conductor" window is 
a window for managing the Conductor as a whole. By 
using the "Conductor" window, It is possible to newly 
prepare, read in, store, execute, and stop a world, 
switch the mouse mode, add or delete an object, etc. 

(a) By selecting the "New" in the file menu, It is pos- 
sible to newly prepare a world. 

(b) To read a world from a file, the "Open" button Is 
depressed or "Open" Is selected from the file menu. 

(c) To store a world in a file, the "Save" button is 
depressed or "Save" Is selected from the file menu. 

(d) To confirm the operation of the world, the "Play" 
button is depressed. 

(e) By depressing the "Pause" button during play, 
the play is stopped once. By depressing the 
"Pause" button again or depressing the "Play" but- 
ton, the play is restarted. The conductor includes a 
mouse mode illustrated in Fig. 10B as an enlarged 
view. 

(f) "Navigate (viewpoint motion)" is used when mov- 
ing the viewpoint in the "2D/3D view" window. 

(g) "Move" Is used when moving the object. 

(h) "Rotate" is used when rotating the object. 
(I) "Scale" is used when changing the scale of the 
object. 

Further, in the Conductor, a Primitive Bar illustrated 
enlarged in Fig. IOC is provided. When adding a primi- 
tive object like a box or cone, the object desired to be 
added Is selected at the Primitive Bar and the "3D View" 
window is clicked. A "Sensor" Is also provided in the 
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Primitive Bar. 

The GUI 40 receives tfie operation input data input 
by the user using the mouse 262 of tiie input device 26 
to depress various buttons in a window displayed on tiie 
display device 24 or using the keyboard 260 and pro- 
vides the required operation data to the tools of the edit- 
ing tool 42 and the scene graph data base 44. That Is. 
the GUI 40 provides a GUI environment to the user. 

The GUI 40 receives the display output data from 
the editing tool 42 and the scene graph data base 44 
and displays the received data in a predetermined win- 
dow of the display device 24. The constituent parts of 
tiie editing tool 42, scene graph data base 44, and work- 
ing tools 46 are activated In accordance with tiie opera- 
tion data input to the GUI 40 and performs processing 
based on the operation data provided from the GUI 40. 

VRML Browser 308 

The VRML browser 308 confirms the final sub- 
stance of the VRML content prepared in the computer 
system 20 and displays the VRML content acquired 
from tiie server apparatus 102 and in addition displays 
a help file linked with the operation of the constituent 
parts of the GUI 40 to the working tool 46. As the VRML 
browser 308 for example, it Is possible to use the Com- 
munity Place (trademark) browser provided by Sony 
Corporation. The Community Place browser will be 
explained as an example below. 

Editing Tool 42 

The editing tool 42, overall, provides tiie user with 
tiie functions necessary for tiie preparation of graphic 
data of an object in a three-dimensional virtual space 
and an interaction program. Below, the parts of the edit- 
ing tool 42 will t>e explained. 

Model Editing Tool 420 

The processing functions of the model editing tool 
420 will be listed below: 

(1) The model editing tool 420 prepares graphic 
data indicating an attribute such as tiie size and 
color (shape) of tiie object. Its position, and opera- 
tion by using tiie data for the model preparation 
input by an operation of the user with respect to a 
model editing use window displayed on the display 
device 24. 

(2) The model editing tool 420 outputs tiie prepared 
graphic data (attribute of object) to tiie scene graph 
data base 44. 

(3) The model editing tool 420 three-dimensional ly 
displays this at a predetermined position of tiie 
model editing use window on the display device 24 
via tiie GUI 40. 

(4) The model editing tool 420 may also edit the 
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graphic data read from the hard disk drive 214. 

(5) The mcxJel editing tool 420 may also edit the 
graphic data read from a floppy disk 280 through a 
floppy disk drive 216 or from an MO disk 282 
through an MO disk drive device 218. 5 

(6) The model editing tool 420 may also edit the 
graphic data downloaded from the network to the 
computer system 20. 

The model editing tool 420 having the above vari- io 
ous functions executes the functions characterizing the 
present invention as explained below: 

a. Object Display Function 

Processing for rotation (by "Rotate" operation is 
of "Conductor" window), motion (by "Move" opera- 
tion of "Conductor" window), navigation (by "Navi- 
gate" operation of "Conductor" window), and 
scaling (by "Scale" operation of "Conductor" win- 
dow) of object for viewing object from different view- 20 
points. 

b. Object Scaling Function 

The "Scale" of the "Conductor" window is used. 

c. Sensor Node Region Display and Setting Func- 
tion 25 

Operates linked with the browser emulator 460. 

d. Parallel View Function 
f. Attention Function 

Routing Editino Tool 422 30 

The routing editing tool 422 performs the routing 
editing for establishing correspondence between the 
graphic data of the object named in the current scope 
(VRML file to be edited) and script and other nodes. 35 
Note that, at the time of routing, it is necessary to make 
the format of the field values of the nodes of the origina- 
tion of routing and the destination of the routing match, 
for example, SFBool (Boolean value showing true or 
false). 40 

Note that details of the routing editing processing 
using the routing editing tool 422 will be described later 
as the setting of the format of the input data. 

Scene Graph Editino Tool 424 45 

In VRML, it is possible to arrange the nodes hierar- 
chically The scene graph editing tool 424 edits the hier- 
archical structure of the objects and invisible nodes 
(saipt nodes etc.) As the hierarchical structure of the so 
nodes, for example, a subnode F1 showing the leaves 
(VRML file), a subnode F2 showing the branches 
(VRML file), a subnode F3 showing the trunk (VRML 
file), and a subnode F4 showing the roots (VRML file) 
comprise hierarchically a main node F5 shoving the tree ss 
as a whole (VRML file). 
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Text Editor 426 

The text editor 426 has an editor function of a pro- 
gramming language suited to the preparation of a script 
of the Java language etc.. prepares a source program of 
the script, and, at the same time, automatically adds, 
deletes, or modifies the variables linked with the editing 
work on the script node. 

Template Preparation Tool 428 

The tenplate preparation tool 428 is a tool used for 
the convenience of the user. It operates linked with the 
text editor 426, prepares a program (template) which 
becomes the prototype of the script by an interactive 
manner in accordance with the operation of the user 
with respect to a "Script Expert" window of the display 
device 24, and outputs the same to tiie text editor 426. 
The user can easily prepare a script by modifying 
according to need a source program (template of script) 
which is provided by the template preparation tool 428 
and has been already completed to a certain extent. 

Scene Graph Data Base (SGDB) 44 

The SGDB 44 stores the data prepared by tools of 
the editing tool 42 in the RAM 206 of the computer 20, 
manages the stored data, and supplies the stored data 
immediately in accordance with requests of the constit- 
uent parts of the editing tool 42 and tiie working tool 46. 

Working Tool 46 

The working tool 46 provides to the client the func- 
tions required for the VRML content preparation work 
such as the confirmation of the prepared content, confir- 
mation of the operation of the script, and tiie recording 
and reproduction of tiie data with respect to the input 
data 26. Below, an explanation will be given of the tools 
of the working tool 46. 

Browser Emulator 460 

The browser emulator 460 emulates the operation 
of the VRML browser 308 and provides tine user with tiie 
same VRML conterrt as in the case of use of the VRML 
browser 308. Therefore, for example, the browser emu- 
lator 460 is used when the user confirms the operation 
of the prepared VRML content. 

The browser emulator 460 is activated in accord- 
ance with the depression of the "Play" button displayed 
in the "Conductor" window of the display device 24 or is 
activated by the depression of the "Play" button pro- 
vided on the keytx)ard 260, stores the result of the emu- 
lation of the VRML conterrt in the scene graph data base 
44. displays the resultant VRML content in a "3D View" 
window (editing window) shown in Fig. 9, and modifies 
ttie substance of the display in accordance with an 
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operation of the user. The browser emulator 460 stops 
operating in accordance with the depression of the 
"Stop" button displayed in the "Conductor" window. TTie 
GUI 40 displays the original editing use VRML content 
when the operation of the browser emulator 460 is 5 
stopped. 

Note that in the confirmation of operation using the 
browser emulator 460, it is preferable that the changes 
of the field values arising due to motion of the moving 
object be successively stored and held, then, along with 
the end of the browser emulator 460 in accordance with 
the "Stop" button, the later explained backup manager 
466 be simultaneously operated with the browser emu- 
lator 460 to restore the original state of display of the 
object. 

File Input/OutPut Unit 462 

The file input/output unit 462 records the graphic 
data of the VRML content [VRML file (extension .wri)], 
script (extension Java), texture file (extension .bmp, 
•jPd> gif) and the sound file (extension .wav, .mod) 
stored in the scene graph data base 44 on a hard disk 
drive 214, floppy disk 280, or MO disk 282 of a compu- 
ter system 20. Further, the file Input/output unit 462 out- 
puts the various data of the VRML content read by the 
hard disk drive 214 etc. to the scene graph data base 
44. 

File Scope Management Unit 464 

In VRML, one scope (range whore name and rout- 
ing attached to the node are valid) in given for every file 
of the graphic data (extension .wrI). and the node 
names and routings are managed in units of scopes. 
The file scope management unit 464 manages the node 
names in the scene graph data base 44, automatically 
prepares the node names, searches for the nodes, and 
propagates modifications with respect to the graphic 
data file to all of the nodes refered to whenever refer- 
ring to a plurality of graphic data files with the same 
nodes. 

Backup Manager 466 

The backup manager 466 corresponds to the 
backup manager 36 of Fig. 3. If the browser emulator 
460 activated by the "Play" button when confirming the 
substance of the VRML content displays a scene which 
can be interactively operated, the state of the nodes 
changes in accordance with the operation by the user, 
so the field values of the nodes end up changing and 
the original scene can no longer can be displayed 
unless being processed in some way For this reason, 
the backup manager 466 receives and stores the Initial 
states of the field values of the nodes (as field values) of 
the scene which is displayed at first in the "3D View" 
window (three-dimensional virtual space generated 



from the VRML file) from the scene graph data base 44 
when the browser emulator 460 is activated In accord- 
ance with depression of the "Play" button of the "Con- 
ductor" window. 

Further, the browser emulator 460 outputs the 
stored field values of the nodes to the scene graph data 
base 44 when the browser emulator 460 stops operat- 
ing in accordance with depression of the "Stop" button 
of the "Conductor" window of the display device 24. 

Due to this, the GUI 40 displays the original three- 
dimensional virtual space in the "3D View" window of 
the display device 24 based on the f lekl values of the ini- 
tial values of the nodes Input to the scene graph data 
base 44. 

Saipt Preparation Unit 47 

The script preparation unit 47 has the functions of 
compiling, confirming the operation, and debugging the 
script prepared by the user using the text editor 426. 

Java Compiler 474 

TTie Java compiler 474 compiles source programs 
of the script of the Java language stored in the scene 
graph data base (SGDB) 44 to prepare the object pro- 
gram and outputs the same to the SGDB 44. In this 
embodiment, when the "Play" button of the "Conductor" 
window Is depressed, the Java compiler 474 can auto- 
matically compile the source programs of the script, that 
is, the files having ".java" as extensions, to automatically 
prepare a file having ".class" as an extension. 

Java Emulator 470 and Java Debupper 472 

TTie Java emulator 470 and the Java debugger 472 
operate as the Interpreter of a program desaibed by the 
Java language and are used by the user for confirming 
the operation and debugging the script program. That Is, 
the Java emulator 470 emulates the operation of the 
object program of the script stored in the scene graph 
data base (SGDB) 44. and the Java debugger 472 out- 
puts the state of the Java emulator 470 at the emulation 
operation and the generated error to the SGDB 44. 

Characteristic Functions of Content Preparation Soft- 
w a re T o ol 4 

Below, an explanation will be given of the sub- 
stance of the processing characterizing the content 
preparation software tool 4 of the present embodiment. 

Operation Confirmation Function and Backup Manage- 
ment Function (Browser Emulator 460. Backup Man- 
ager 46Q) 

As explained referring to Fig. 4 to Fig. 6, when the 
user depresses the "Play" txjtton displayed in the "Con- 
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ductor" window in the screen of the display device 24 by 
the mouse 262 (Fig. 5. S301 , Rg. 6, S311 ). the browser 
emulator 460 analyzes the VRML content prepared up 
to this point of time and displays It on the display device 
24. Preferably, as illustrated in Fig. 6, the backup man- 
ager 466 also operates simultaneously and becomes 
able to back up field values. The backup manager 466 
successively stores the field values of the nodes 
expressing a moving object when a moving object etc. is 
clicked (Fig. 6. S223) (S224). Further, when the "Stop" 
button is depressed (Fig. 6. S225), the normal editing 
mode is returned to and the backup manager 466 
restores the field values (Fig. 6, S226). 

That Is, when the state of the VRML content at the 
time of starting the confirmation of operation is stored 
by the backup manager 466, the user depresses the 
"Stop" button displayed in the "Conductor" window In 
the screen of the display device 24 by the mouse 262, 
and the browser emulator 460 stops executing the 
VRML content, it is possible to return the VRML content 
to the field values at the time of starting the confirmation 
of operation and return the substance of the display of 
the object (model) of the window to that at the start of 
confirmation of operation. 

By this operation confirmation and backup manage- 
ment function, tiie trouble of once storing the prepared 
VRML content in the hard disk drive 214 etc. and then 
activating the VRML browse to confirm the operation 
like in the prior art described witii reference to Fig. 1 is 
unnecessary. In addition, the user can confirm tiie oper- 
ation of the content prepared by the work up to then at 
any time during tiie VRML content preparation work. 

File Automatic Preparation Function (Java Compiler 
474) 

When the user depresses the "play" button of the 
"Conductor" window for confirmation of the substance 
of the VRML content, tiie Java compiler 474 automati- 
cally compiles source programs of the script, for exam- 
ple, files having ".java" as tiie extension, to 
automatically prepare an object program having ".class" 
as an extension for example. 

Script Program Preparation and Debugging Function 
(Text Editor 426) 

The user can use the text editor 426 to prepare a 
source program of the script by the Java language or 
other program language suited to the script preparation 
and compile the source programs prepared by using the 
Java compiler 474 to prepare tiie object program. 

This object program is also executed when confirm- 
ing tiie operation by the browser emulator 460 in addi- 
tion to when operating the VRML content by the VRML 
browser 308. 

Further, when adding a debug code to the source 
program and executing tiie same at tiie Java emulator 



470. ttie Java debugger 472 displays tiie value of the 
input/output of the script etc. and enables the debug- 
ging work of the script. 

5 Template Automatic Preparation Function (Text Editor 



When the user sets the values of the input/output of 
the script node by an interactive manner, the template 

10 preparation tool 428 prepares a template (template) of 
tiie source program of the script suited to this setting. 
The user can use the text editor 426 to add the required 
modifications to the template and thereby prepare the 
source program of the script for realizing the desired 

15 event. By this function, tiie user can eliminate the trou- 
ble of preparing all source programs of tiie script by the 
editor and in addition can prevent occurrence of simple 
coding mistakes. 

20 Object Displav Function (Model Editino Tool 420) 

The model editing tool 420 enables normal display 
and display from different viewpoints. 

Rgure 1 1 is a view of an example of an object dis- 

25 played In the "3D View" window of a GUI screen of tiie 
display device 24. 

The model editing tool 420 displays a three-dimen- 
sional perspective projection view (3D perspective view) 
of the object indicated by the prepared graphic data in 

30 tiie "3D View" window In the GUI screen (Fig. 9). Below, 
tills will be called the "3D View" window. In this state, if 
the user clicks and selects an object in the "3D View" 
window and clicks and selects one of a "Rotate" button, 
"Move", "Navigate", or "Scale" button displayed in the 

35 "Conductor" window of the GUI screen shown in Rg. 
10A to change the rotation, motion, or viewpoint motion 
operation mode and further if the user depresses the 
left button of the mouse 262 and drags on the inside of 
ttie "3D View" window or clicks on it by the left button of 

40 ttie mouse 262. the model editing tool 420 displays an 
image (object) obtained by rotating or moving tiie 
selected object (model) on the display device 24 In 
accordance with the mouse mode (rotation, motion) and 
tiie operation of the user witii respect to the "3D View" 

45 window. When ttie user selects "Navigate (viewpoint 
motion)" as the operation mode, the model editing tool 
420 uses the position in tiie "3D View" window clicked 
by the user as the viewpoint and displays the image 
when viewing the selected object from tiiis viewpoint. 

50 Therefore, according to the above processing of the 
model editing tool 420, it is possible to view the object 
from various viewpoints. 

Note, when performing tiie processing for changing 
ttie viewpoint, tiie positioning the object to be processed 

55 to the center of the window is preferable on the view 
point of the operability. Accordingly, the model editing 
tool 420 automatically makes tiie object concerned 
move to tiie center of the window. This processing is 
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called "POI" (point of interest). That is, in the present 
invention, as shown in Fig. 12, there is a POI (point of 
interest) mode. As shown in Fig. 12, when a user uses 
the mouse 262 to point to and selects an object (cone) 
in the "^D View" window and selects POI (point of inter- 
est) from the pop-up menu, the model editing tool 420 
matches the viewpoint with the selected object, the 
viewpoint of the object moves as shown in Fig. 1 2 to Fig. 
14, and finally the selected object is displayed at the 
desired position in the "3D View" window as shown in 
Fig. 14, that is, in the illustration of Fig. 14, the center 
position of the window. If the object is made to move to 
the desired position (center position of the window) by 
the POI (point of interest), then processing such as 
"Navigate", "Move". "Rotate", or "Scale" is used to move 
the viewpoint of the object, it becomes possible to view 
the object in the desired state from different viewpoints. 
Further, since the object is moved to the center of the 
window or other desirable position by POI (point of inter- 
est) when performing the "Navigate", "Move", "Rotate", 
or "Scale" operation, the operation for moving the view- 
point becomes easy 

For details of the POI (point of interest), an example 
of the POI (point of interest) operation is given with ref- 
erence to the display of Fig. 12 to Fig. 14, Figure 12 is a 
view of the method of selection of the POI (point of inter- 
est). Figure 13 is a view of the state of making the object 
corresponding to the selected node move to the center 
of the window. Figure 14 is a view of the state of move- 
ment of the graphic of the object corresponding to the 
selected node to the center of the window by the POI 
(point of interest). 

In Rg. 12 to Fig. 14. the left side shows the scene 
graph window in a screen of the display device 24 illus- 
trated in Fig. 9, while the right side shows the "3D View" 
window. The "3D View" window is used below as the 
editing window for the model editing tool 420. 

Figure 12 

(1) If the desired node, in this illustration the word 
"Cone", is clicked by the left button of the mouse 
262 from the scene graph window illustrated at the 
left side of Fig. 12. the nrodel editing tool 420 
reverses the black and white colors of the word 
"Cone" of the scene graph window to clearly indi- 
cate to make the selection state a "graphic of a 
cone". 

(2) If the user depresses the right button of the 
mouse 262 after confirming the inverted black and 
white state of the word "Cone", the model editing 
tool 420 displays the pop-up menu as illustrated in 
Fig. 12. 

(3) The user selects "Point of interest" from the pop- 
up menu. In response, the nxxiel editing tool 420 
reverses the black and white colors of the wads 
"Point of interest". The user confirms this, then 
clicks the left button of the mouse 262. 



Figure 13 

(4) As illustrated in the window at the right side of 
Rg. 13, the model editing tool 420 makes the 

5 graphic of the object corresponding to the selected 
node, that is, the front view of the "graphic of a 
cone", gradually to the center of the front view of the 
window. The user can view the state of movement 
of the "graphic of the cone". 

10 

F igure 14 

Rgure 14 shows the state of completion of move- 
ment where the graphic of the object con'esponding to 
15 the selected node, in this example, the cone, is dis- 
played at the center of the window at the right side of 
Fig. 14 in an enlarged state. As illustrated in Fig. 14, the 
graphic of the object is displayed at the center of the 
window in a suitable size. 

20 

(5) In this state, the user can perform processing for 
changing the desired viewpoint. As the method for 
viewing from different viewpoints, there are "Navi- 
gate", "Move", "Rotate". "Scale", etc. as shown in 

25 the "Conductor" window illustrated in Fig. 10. 

Scaling Function of Object (Model Editing Tool 420) 

If making the operation mode of the mouse 262 the 

30 "scale" in the "Conductor" window shown in Fig. 10A 
and, for example, the user moves the cursor while 
depressing a predetermined button of the mouse 262 or 
inputting an operation for instructing a modification of 
tiie size of the object or data showing the size after the 

35 modification from tiie keytxjard 260, the model editing 
tool 420 modifies tiie dimensions (size) of ttie object in 
accordance with tiie motion of the cursor and displays 
tiie same. When the user releases the button of the 
mouse 262. the model editing tool 420 finally sets tiie 

40 size of the model and modifies the content of tiie 
graphic data of the object so as to display the object of 
tiie size at tiie time of tiie final setting in tiie tiiree- 
dimensional virtual space. 

Note that it is possible for tiie user to combine tiie 

45 modification of the mouse mode and tiie operation of 
tiie mouse 262 to make for example the routing editing 
tool 422 rotate and move the object and also enlarge 
(reduce) and display the changed image in the "3D 
View" window. That is, this processing is processing 

50 effective when viewing an object from different view- 
points. 

Further, if the user for example releases tiie prede- 
termined button of the mouse 262 or performs another 
operation for instructing modification of the graphic 
55 data, the model editing tool 420 modifies the content of 
the graphic data of the object (model) in accordance 
with tiie object displayed on the display device 24. 
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Region Display and Setting Function of Sensor Node 
(Model Editing Tod 420 and Browser Emulator 460) 

A sensor is provided in the Primitive Bar illustrated 
in Fig. 10A and Fig. 10C for generating an event when 5 
the user clicks and points to an object in a virtual space 
displayed in a window of the screen of the display 
device 24. When the sensor generates an event, script 
routed to the sensor is executed, and the cursor moves 
outside the region (boundary box) of the sensor node, io 
the script stops being executed. 

The sensor node region display and setting function 
is a function for confirming and nrKxIifying the range of a 
valid region In a touch sensor given to an object for gen- 
erating an event in accordance with an operation by the is 
mouse 262 etc.. a sound node outputting a sound in 
accordance with an operation of the mouse 262 etc., or 
other three-dimensional virtual space. 

An explanation will be made of the sensor node 
region display and setting function referring to Fig. 15. 20 

S301 : The user clicks on an object in the "3D View** 
window using the mouse 262. 

S302: The model editing tool 420 operates in 
response to the atx)ve operation of the user. The model 
editing tool 420 selects the clicked object and causes 25 
the bounding box sun-ounding the selected object to 
blink 

S303: Further, the user clicks on the "Sensor" tab of 
the "Conductor" window In the menu screen to desig- 
nate for example a touch sensor (TouchSensor) or the 30 
like. 

S304: The model editing tool 420 adds a touch sen- 
sor etc. to the object in accordance with the operation of 
the user. 

In this initial stage, the range Indicated by the 35 
bounding box indicating the selection of the object 
becomes the range of the valid region of the touch etc. 

S305: Further, the user inputs a command for 
Instructing a modification of the range of the valid region 
of a sensor from the keyboard 260 and data showing the 40 
range of the valid region after the modification or uses 
the mouse 262 to point to the range of the valid region 
after the modification. 

S306: The model editing tool 420 modifies the 
range of the valid region of the sensor etc. and displays 45 
the range of the valid region of the sensor etc. after the 
change by the bounding box in accordance with the 
operation of the user. Note, in the following embodi- 
ments showing as the examples, the shape of the 
bounding line Is represented as the box-like shape (i.e., so 
the bounding box), but, the shape of the bounding line is 
not limited to the bounding box-like shape, for mediat- 
ing-out the embodiments of the present Invention. 

The display function and scaling function men- 
tioned above are possible also with respect to the fot- 55 
lowing line (the bounding box). The user can make the 
model editing tool 420 perform rotation, motion, and 
enlarged or reduced display of the bounding box by the 



above operation. The model editing tool 420 sets the 
range defined by the bounding box modified by these 
operations as the range of the valid region of the sensor 
etc. after modification. 

S307: Further, the user depresses the "Play" button 
displayed in the "Conductor" window by the mouse 262 
for confirming the substance after the modification. 

S308: The browser emulator 460 operates in 
response to the operation of the user. The browser 
emulator 460 executes the operation for analyzing and 
displaying the content. Note that preferably, as 
explained In the above section "Confirmation Opera- 
tion", the backup manager 466 is also activated simulta- 
neously with the browser emulator 460 so as to enable 
storage and restoration of the field values due to a mov- 
ing object while confirming the VRML content by the 
browser emulator 460. 

S309, S310: In the state with the browser emulator 
460 operating, for example if the user moves the cursor 
of the mouse 262 into the bounding box, the sensor 
generates the event and the script routed to the sensor 
is executed. If moving the cursor to the outside of the 
bounding box, the execution of the script is stopped. 

S31 1 : The execution of the VRML content by the 
browser emulator 460 is stopped by the user depress- 
ing the "Stop" button displayed In the "Conductor" win- 
dow to return the operation of the content preparation 
software tool 4 to the preparation mode. 

Parallel View Function (Model Editlna Tool 420) 

Rgure 16 is a view of a pop-up menu displayed in 
the "3D View" window of the display device 24. Figure 
1 7 is a view of the parallel view function. 

If the user clicks on a predetermined button of the 
mouse 262 (right button of mouse) in the "3D View" win- 
dow in a state where the browser emulator 460 is 
stopped, as shown In Fig. 16, the model editing tool 420 
displays the pop-up menu in the "3D View" window. If 
the user selects one Item from the pop-up menu, the 
model editing tool 420 two-dlmensionally displays a 
side view of the object, a top view, or a view by a wire 
frame in the "Parallel View" window in the menu screen 
of the display device 24. 

Attention Function (Model Editing Tool 420) 

The attention function is a function used for con- 
firming the shape of on object displayed in the "3D 
View" window. It arranges and displays objects as the 
user sees them from a viewpoint designated in the con- 
tent preparation software tool 4 in the three-dimensional 
virtual space around one among the one or more 
objects selected by the user by the mouse 262 in the 
"3D View" window. 

The model editing tool 420 displays one or more 
objects prepared in the "3D View Window" an^anged in 
a three-dimensional virtual space. 
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As the menu screen displayed on the display device 
24, that illustrated in Fig. 18 and Fig. 19 is shown. Fig- 
ure 20 to Fig. 22 are views of objects displayed in the 
"SD View" window as first to third exannples showing the 
attention function. The objects shown in Fig. 18 to Fig. 
19 are cones, but the objects displayed in Fig, 20 to Fig. 
22 are embellished cones. 

The attention function will be explained with refer- 
ence to the flow chart of Fig. 23. 

S321 : The user clicks the "Navigate" button by the 
mouse 262 in the "Conductor" window as shown in Fig. 
18 to enter the viewpoint motion (Navigate) mode. 

S322: The user clicks on and selects a conical 
object by the left button of the mouse 262 as shown in 
Fig. 18 or Fig. 20 in a "3D View" window displaying for 
example the conical object shown in Fig. 18 or the con- 
ical object and the embellished cylindrical object shown 
in Fig. 20. The model editing tool 420 surrounds the 
selected conical object by the bounding box to indicate 
that it has been selected. 

S323. S324: TTie user selects "Attention On" of the 
pop-up menu displayed by clicking the right button of the 
mouse 262 as shown in Fig. 18. Due to this, the model 
editing tool 420, as shown in Fig. 19 or Fig. 21 , changes 
the background of the viewpoint position display panel 
to yellow and changes the direction of the line of sight 
so that the selected object is at the center of the "3D 
View" window. The position of the viewpoint does not 
change, however, so the distance to the object remains 
the same. 

S325: When the user depresses the left button of 
the mouse 262 and drags around the object, as illus- 
trated in Fig. 22, the position of the viewpoint and the 
direction of the line of sight of the object change accord- 
ingly, so it is possible to view the object from various 
directions. That is, the model editing tool 420 changes 
the substance of the display of the "3D View" window in 
accordance with the designation of the user to an image 
of the conical object and cylindrical object as seen when 
using the position designated in the three-dimensional 
virtual space as the viewpoint. In this way, by using the 
attention function, the user can view not only the object 
itself rotated, but also the entire scene actually dis- 
played in the "3D View" window rotated in the three- 
dimensional virtual space and therefore can easily 
obtain a grasp of the entire image of the object. 

S326: When finishing viewing, the user, as shown 
in Fig. 19, selects "Attention OFF" in the pop-up menu. 
By this, the attention function of the model editing tool 
420 is ended. 

Rout i ng Edit i ng F Mn ctlo n; Set ting o f T yp e of Inpu t Pa ta 
(Routine Editinc Tool 422) 

In VRML 2.0, it is possible to define the transfer of 
events between fields of the nodes by the route text 
such as the following: 

ROUTE NODEI.fieldl TO NODE2.field2 



In this example, it is defined to send an event to a 
field given the field name (eventOut) of lieldl" of the 
node given the node name (NodeName) of "MODEL". 
In this route text, rt is necessary that the data type (Data 
5 Type) preset for the file name (eventOut) of the side out- 
putting the event and the data type (Data Type) preset 
for the file name (eventOut) of the side inputting the 
event match. 

When the user selects the field names of nodes on 

10 tiie side inputting an event, the routing editing function 
displays just field names matching the data type preset 
for the field name of the node of the side outputting the 
already selected event as a pull down list (drop down 
list) in the ComboBox. By presenting to the user just the 

75 field names for which routing Is possible in tiiis way, the 
user can avoid the problem of describing mistaken route 
text and therefore the work of the describing the routing 
is made easier for the user. 

The routing editing function will be further explained 

20 with reference to Fig. 24 and Fig. 25 to Fig. 27. 

Rgure 24 is a flow chart of the processing of tt^e 
routing editing function. 

Rgure 25 to Fig. 27 are views of the "Route" win- 
dow showing an exarrple of the routing editing function. 

25 The routing editing function, in other words, the 
processing for setting the type which may be input, will 
be explained with reference to Fig. 24. The following 
processing is executed by interactive manner of tiie 
routing editing tool 422 witii the user. 

30 S331 : The "Route" window is opened by the user 
and the routing editing tool 422 judges if the mouse has 
been operated to display the pull down list (drop down 
list) of tiie node names (NodeName) or tiieir field names 
(eventOut) of the upper side outputting events. 

35 S332: The routing editing tool 422 extracts tiie node 
names (NodeName) or tiieir field names (eventOut) of 
tiie side outputting events which can be selected and 
displays the same as a pull down list (also called a Com- 
boBox). 

40 S333: "TSr for example is displayed by the routing 
editing tool 422 as the node name (NodeName) of tiie 
side outputting the event selected by the operation of 
the user to select from tiie menu using the mouse and 
"isActive" for example is displayed by the routing editing 

45 tool 422 as the field name (eventOut) from the pull down 
list displayed as shown in Fig, 25. The data type (Date 
Type) preset for the selected field name, for example 
SFBool (Boolean value showing true or false, taking one 
of value of FALSE (0) or TRUE (1)), is displayed as ref- 

50 erence in the right adjoining region of the field name 
(eventOut) by the routing editing tool 422. 

S334: Whether or nottiiere his been a mouse oper- 
ation by the user for displaying the pull down list of tiie 
node names (NodeName) of tiie lower side inputting tiie 

55 event is judged by the routing editing tool 422. 

S335: As shown in Fig. 26, for example, "PL1" and 
"TS1 " are displayed by the routing editing tool 422 in tiie 
pull down list as node names (NodeName) of tiie input 
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side of the e\^ent which may be selected. 

S336: The node name (NodeName) of the side 
inputting the event selected by the operation of the user 
to select from the menu using the mouse 262 is dis- 
played by the routing editing tool 422 from the pull down s 
list shown in Fig. 26. 

S337: Whether or not there has been a mouse 
operation by the user for displaying the pull down list of 
the field names (eventin) of the lower side inputting the 
event is judged by the routing editing tool 422. io 

S338: As shown in Fig. 27, just the field names 
(eventOut) of the side inputting the event which can be 
selected are displayed in a pull down list by the routing 
editing tool 422. In this case, only the field names 
named "on", that is. the field names which match the is 
data type preset for the field name of the node of the 
side outputting the event already selected by the user 
(in this case, which match SFBool). are displayed in the 
pull down list by the routing editing tool 422. 

S339: The field name (eventOut) of the node of the 20 
side inputting the event selected by the menu selection 
operation by the mouse from the pull down list shown in 
Fig. 27 is displayed by tiie routing editing tool 422 and 
the route text con^esponding to the node names and the 
field names for transferring the event selected by the 25 
above menu operation is generated at the routing edit- 
ing tool 422. 

In this way, according to the routing editing function, 
since just the file names of tiie nodes matching the type 
of tiie data of tiie event to be transferred between the 30 
fields of the nodes are displayed to the user, the user 
can select one of the file names displayed to set the 
type of ttie routing. Therefore, it becomes easy to set 
the type of data of the routing and mismatches of the 
types of data between nodes due to careless error etc. 35 
and other problems can be prevented. 

Routing is deleted by selecting the routing desired 
to be deleted and then depressing the "Delete" button. 
The routing editing tool 422 deletes the routing con- 
cerned in accordance witii this operation. 40 

Script Editina Function (Text Editor 426) 

When tiie user modifies the value of the input/out- 
put of the script node ("eventin", "eventOut). tiie text edi- 45 
tor 426 automatically modifies the source program of 
the script corresponding to the script node so as to be 
compatible with the value of the input/output after the 
modification. 

50 

File Scope Function (Scene Graph Editina Tool 4241 

When the user selects the VRML file to be edited in 
the "Conductor" window etc. of the menu screen of the 
display device 24. the scene graph editing tool 424 dis- 55 
plays the nodes referred to by tiie selected VRML file to 
be edited in the "Scene Graph" window in the form of for 
example a hierarchical tree. The set of nodes refen^ed to 



by the VRML file to be edited in tiiis way will also be 
referred to as a "file scope". 

The scene graph editing tool 424 limits tiie nodes 
for routing, script preparation, and other editing to tiie 
file scope displayed in the "Scene Graph" window. Fur- 
ther, the content of the file scope and the nodes which 
may be edited are changed to the nodes refen-ed to by 
tiie VRML file after modification in accordance with 
modification by tiie user of the VRML file to be edited. 

Note that the saipt editing function is valid through- 
out the nodes in the same VRML file (in file scale). 
When the user modifies the value of the input/output of 
tiie script node in the same VRML file ("eventin", "event- 
Out), the text editor 426 automatically changes the 
source programs of the script con'esponding to tiie 
script node in the same VRML file (displayed in the 
same file scope) to be compatible with the value of the 
input/output after tiie modification so as to maintain the 
match of the descriptions between tiie script nodes 
(Inline management function). Further, in the VRMLfile, 
tiie name of the node must be unique, therefore the text 
editor 426 automatically changes the node name so that 
tiie name of tiie copied and pasted node becomes 
unique in tiie same VRML file so as to avoid overlapping 
of the node name (naming function at paste). 

Basic Metiiod of Preparation of VRML Content 

An explanation will next be given of an example of 
ttie preparation of VRML content by the content prepa- 
ration software tool 4. 

Rgure 28 is a view of an example of a conical object 
prepared by tiie content preparation software tool 4. 

An explanation will be made of the case of prepar- 
ing the content (first content) for attaching a sensor to 
tiie conical object shown in Fig. 28 and making tiie cone 
bright or dark (turning ON/OFF the light) in accordance 
with pointing to the sensor as a first specific example of 
preparation of content of three-dimensional virtual 
space (VRML content) using the content preparation 
software tod 4. 

The VRML content is prepared by the process illus- 
ti-ated in Fig. 29. That is, 

S401: Preparing the graphic data [an^anging the 
geometry node of the object {geometi"y node 
(cone)}] 

S402: Adding the sensor [arranging the sensor 
node (TouchSensor) 

S403: Attaching a light node [arranging a node pre- 
scribed by VRML {common node (PointLight)} 
S404: Naming the node being routed 
S405: Setting the route 
S406: Confirming ttie operation 

Details of the process will be explained below: 
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S401 : Preparation of Graphic Data f Arrangement of 
geometry Node (Cone)] 

The user arranges the object in the three-dimen- 
sional virtual space (world) to construct the entire setup, s 
The object which can be arranged in the three-dimen- 
sional virtual space as the object by using the content 
preparation software tool 4 is provided by for example a 
basic node of VRML 2.0 or library window. 

It is also possible for the content preparation soft- io 
ware tool 4 to read the graphic data of an object pre- 
pared by other nrKXf eling software by converting this to a 
file format compatible with VRML 2.0. 

When the user activates the content preparation 
software tool 4, the graphical user Interface (GUI) 40 15 
displays the GUI menu screen shown in Fig. 9 on the 
display device 24. When the user selects the item of 
"Rle/New" in *'Ck)nductor" window by using the mouse 
262 etc., the model editing tool 420 of the content prep- 
aration software tool 4 newly prepares an empty world. 20 

The user performs the work for placing the conical 
object (cone) in the prepared empty world. When the 
user selects "Cone" from the "Geometry" tab of the 
"Conductor" window and clicks on the window for the 
graphic data preparation (hereinafter described as the 25 
"3D View" window), the nrKxJel editing tool 420 of the 
editing tool 42 prepares the graphic data of the object 
(cone) and displays the conical shape (cone) shown in 
Fig. 28 in the "3D View" window. Note that, at this time, 
it is also possible for the user to use the attention func- 30 
Won of the content preparation software tool 4 to display 
the image visible when moving the periphery of the 
object (cone) in the three-dimensional virtual space in 
the "30 View" window and confirm the shape of the 
object (cone). 35 

S402: Addition of Sensor rAnranoement of Sensor Node 
rrouchSensor)] 

In order to add motion to the object in the three- 40 
dimensional virtual space or make this react with the 
operation of the user, it is necessary to add a sensor to 
the object, detect a constant condition for the operation 
of the user with respect to the object, and transmit the 
change thereof as the event to the other nodes. 45 

Below, this will be explained by taking as an exam- 
ple the addition of the touch sensor (TouchSensor) for 
detecting a pointing operation by the mouse 262 with 
respect to the object. 

The sensor is added to the object by placing the so 
object in the selection state and then generating the 
sensor (TouchSensor). 

(1) First, when the user clicks on the object (cone) 

in the "3D View" window, the model editing tool 420 55 
selects the clicked object and makes the bounding 
box surrounding the selected object blink. 

(2) Further, when the user clicks on the "Sensor" 



tab of the "Conductor" window, selects the touch 
sensor (TouchSensor) located at the rightmost side 
of the "Sensor" tab, and clicks on the "3D View" win- 
dow, the model editing tool 420 adds the touch sen- 
sor to the object and adds the data thereof to the 
graphic data of the object. Note that, at this stage, 
as mentioned above, it is also possible for the user 
to use the keyboard 260 or the mouse 262 to mod- 
ify the range of the valid region of the sensor 
(TouchSensor). 

Rgure 30 is a view of the "Scene Graph" window in 
the menu screen. 

The scene graph editing tool 424 modifies the con- 
tent of the display of the "Scene Graph" window in the 
menu screen as shown in Fig. 30 in accordance with the 
addition of the touch sensor to the object. The user can 
confirm that the touch sensor (TouchSensor) was added 
to the object, in this example a cone, by referring to the 
"Scene Graph" window shown in Fig. 30. 

This example shows a case of adding a sensor 
(TouchSensor) to a simple object such as a cone, but it 
is also possible to add a sensor (TouchSensor) to a 
more complex object than a cone by a similar operation 
of the user. 

S403: Addition of Common Node (PointLioht) 

In VRML 2.0, the operation is described by the flow 
of transmitting the event detected by the sensor (sensor 
node) to another node and having the node receiving 
the event modify its state. 

Below, this will be explained by taking as an exam- 
ple a case when a common node (PointUght) for mak- 
ing the light blink is added as the node receiving the 
event. 

The common node (PointLight) lies in the "Com- 
mon" tab of the "Conductor" window. However, when 
producing a light at the same position as the object 
while maintaining the illustrated display as it is. it 
becomes invisible, therefore it is necessary to move the 
viewpoint in advance. 

When the user makes the "3D View" window active 
and for example depresses a down arrow key i off the 
keyboard 260, the model editing tool 420 displays the 
object seen from the position of a slightly away from the 
viewpoint in the "30 View" window. When selecting the 
common node (PointLight) in this state, the model edit- 
ing tool 420 displays the object (cone) brightly as shown 
in Fig. 31. 

S4Q4: Naming of Node to be Routed 

Next, the user carries out routing between nodes, 
for example, establishes correspondence from the sen- 
sor (TouchSensor) to the common node (PointLight). 

The "routing" means the connection of the two for 
transmitting the event among nodes, for example, from 



18 



35 



EP 0 890 926 A1 



36 



the sensor to the script 

tn order to perform this routing, it is necessary to 
first add a name (DEF name) to the sensor. 

Figure 32 and Fig. 33 are views of the work of nam- 
ing the sensor node by the "Attribute" window. s 

The "Attribute" window is a window for modifying an 
attribute of the selected object. The name (DEF name) 
is added to the node by an operation with respect to the 
"Attribute" window. Here, this will be explained by taking 
as an example a case where the user selects the sensor io 
(TouchSensor) from the "Scene Graph" window and 
adds the DEF name (TS1, PL1) in the "Attribute" win- 
dow. 

As shown in Fig. 32, when the user designates the 
position of the "DEF name" in the "Attribute" window, is 
types "TS1" from the keytx>ard 260. and pushes the 
return key and, further, as shown in Fig. 33. selects the 
common node (PointLight) from the "Scene Graph" win- 
dow, types "PL1", and pushes the return key, the scene 
graph editing tool 424 adds the DEF names "TS1" and 20 
"PLI" to the sensor (TouchSensor) and the common 
node (PointLight). respectively 

Further, when the user double clicks for example 
the "On" field of the common node (PointLight) of the 
"Attribute" window, the text editor 426 turns off the initial 25 
state of the light arxi adds the same to the graphic data 
of the object. 

S405: Settino of Route 

30 

Figure 34 is a view of an example of the "Route" 
window used for setting the routing between nodes. 

The user performs sets the routing so as to transmit 
the event generated in the sensor (TouchSensor; TS1) 
to the common node (PointLight; PLI). The content 35 
preparation software tool 4 sets the routing by the 
"Route" window shown in Fig. 34. 

In the "Route" window illustrated in Fig. 34, the 
upper "NodeName" position is used for setting the node 
name on the output side, while the lower "NodeName" 40 
position is used for setting the node name on the input 
side. Since the event is to dick on the sensor (Touch- 
Sensor) and then turn the light on/off, when the user 
sets TS1 in "NodeName" on the output side and selects 
"isActive" for "eventOut", the format "SFBool" is dis- 45 
played on the right side. Note that the display of 
"SFBool" on the right side indicates that the format of 
the event transferred in "isActive" is SFBool. 

The user sets PL1 in "NodeName" and sets "on" in 
"eventin" as the setting on the input side. so 

In accordance with the setting by the user, the rout- 
ing editing tool 422 modifies the display of the "Route" 
window of the display device 24 as shown in Fig. 34. 

When the above setting is ended and the user 
depresses the "Add" button, the routing editing tool 422 ss 
establishes correspondence between the sensor 
(TouchSensor) and common node (PointLight) for the 
routing and adds the route among nodes. 



S406: Confirmation of Operation 

When the user depresses the "Play" button dis- 
played on the display device 24, this is input to the 
graphical user Interface (GUI) 40 of the content prepara- 
tion software tool 4 and the operation of the VRML 
browser 308 is emulated by the browser emulator 460 of 
the content preparation software tool 4. Therefore, it is 
possible to confirm the VRML content at any timing dur- 
ing the work for preparation of the VRML content with- 
out activating the VRML browser 308. 

Further, when the user depresses the "Play" button 
displayed on the display device 24, the normal content 
preparation work is returned to. 

Below, the work for confirmation of the content will 
be explained. 

When depressing the "Play" button (button with 
right facing triangle mark) located at the bottom left of 
the "Conductor" window by the mouse 262, the content 
preparation software tool 4 emulates the operation of 
the browser by the browser emulator 460 from the oper- 
ation for preparation of the content (preparation mode) 
and then shifts to the operation for confirming the pre- 
pared content (simulation mode). 

When shifting to the simulation mode, the backup 
manager 466 stores the states of the nodes of the 
VRML content at this point of time and the viewpoint of 
the user. The browser emulator 460 then executes the 
VRML content and displays the same on the display 
device 24. When the user depresses the object (cone) 
displayed in the "3D View" window by the mouse 262 
while the browser emulator 460 executes and displays 
the VRML content, the object is displayed bright (Ught 
ON) when depressed and the object is displayed dark 
(Light OFF) when not depressed. 

In this way in the simulation mode, when the user 
clicks on the object (cone) by the mouse 262, the sen- 
sor (TouchSensor) attached to the object detects the 
click and the event is generated. The generated event is 
transmitted to the common node (PointLight) by the set- 
ting of the routing, the common node (PointLight) 
changes the state, the object is turned ON, the event is 
generated by the similar fbw even at the end of the 
dick, and the common node (PointLight) turns off the 
light of the object. 

Further, when the user depresses the "Stop" button 
(button with square mark) of the "Conductor" window by 
the mouse 262, the content preparation software tool 4 
returns to the usual content preparation mode. 

When returning to the VRML content preparation 
mode, the backup manager 466 returns the state of the 
content to the stored initial state at the point of time 
when it enters into the simulation mode and further 
returns the viewpoint of the user to the position at the 
point of time when it enters into the simulation mode. 
The model editing tool 420 displays the graphic data of 
the initial state in the "3D View" window. 
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Storage of Prepared VRML Content 

When storing the file, when the user designates the 
file name by the "RIe/Save As" menu of the menu 
screen, the file input/output unit 462 records the file of s 
the VRML content stored in the scene graph data base 
44 in an e)cternal recording medium 28 via the hard disk 
drive 214 or the floppy disk drive 216 and the MO disk 
drive device 218. It is also possible for the user to open 
and view the file of the recorded content by the browser io 
308. 

As explained above, it will be understood that, when 
preparing and confirming simple content for displaying 
the conical object bright or displaying it dark in accord- 
ance with a click by the mouse 262, it is possible to add is 
the graphic data of the object, add a sensor, and add the 
routing by an interactive operation by the graphical user 
Interface 40 without programming by input of a complex 
character train command. 

20 

Preparation of Complex Content 

Below, an explanation will be made of the case of 
preparing VRML content (second content) changing the 
color of the object when the mouse cursor comes over 25 
the object as a second specific example of preparation 
of content of tiiree-dimensional virtual space (VRML 
content) using the content preparation software tool 4. 

The above VRML content was comprised to trans- 
mit an event generated by a sensor (TouchSensor) 30 
attached to the object to another node [comnrran node 
(PointLight)], but in VRML 2.0, script is interposed 
between the sensor and tiie other node and furtiier 
complex nation can be realized. 

For example, in order to realize the second content 35 
by VRML 2.0, the color of the object (cone) is desig- 
nated by the material attribute. This material attribute 
includes a plurality of fields. By setting diffuse color as 
the material attribute, the color of the object can be 
changed. In such a case, it is necessary to set the mate- 40 
rial atti-itxjte ''diffuse color" in accordance with the gen- 
eration of the event. In such a case, diffuseColor can be 
set by interposing the script. 

The work of preparing tiie second content becomes 
the routine illustrated in Fig. 35. That is, 45 

S411: Preparing tiie graphic data [arranging the 
geometry node (cone)] 

S412: Adding a sensor [arranging a sensor node 

(TouchSensor)] 50 

8413: Naming the node to be routed 

S414: Preparing the script 

8415: Describing a program corresponding to the 

script (only debug code) 

8416: Setting a route to the script 55 
8417: Confirming the operation 
8418: Describing a program conresponding to the 
script (setting the color) 
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8419: Setting the route to the material node 
8420: Confirming the operation 

Note that, the operation of steps 41 1 and 41 2 is the 
same as the operation of steps 201 and 202 described 
witii reference to Fig. 29, so the explanation will be omit- 
ted. 

Below, tiie work of the preparation of the second 
content will be explained. 

S413: Naming Node to be Routed 

In VRML 2.0, in order to perform the routing, it Is 
first necessary to add names. In the preparation of the 
first content, as mentioned above, names (T81 and 
PL1) were added to the sensor (TouchSensor) and 
common node (PointLight). In the preparation of the 
second content. It is necessary to further name the 
material attribute. 

Rgure 36 is a view of the "Appearance" window in 
tiie menu screen. 

In VRML 2.0. the material attribute Is contained in 
tiie appearance node for setting an attribute such as the 
color added to the object and the bit map data. In the 
content preparation software tool 4, the "Appearance" 
window of the menu screen is used for the editing of the 
appearance (including material, texture, etc.) of the 
graphic data of the object selected In the "3D View" win- 
dow. 

When giving a name to the material attribute of tiie 
object, the user first clicks on and selects the object by 
tiie mouse 262. selects the "Material" tab of ttie 
"Appearance" window shown In Fig. 36, and gives a 
name, for example, "C0NE1_MAT". 

S414: Preparation of Saipt Node 

In VRML 2.0, there is a node for Interfacing with the 
script program referred to as a script node. This script 
node Is contained In tiie VRML file and enables the 
description of a complex operation by using a script 
described by for example the Java language. However, 
the script node has an Interface function, so has a dose 
relationship with tiie opposing script for the interfacing 
and further enables definition of a plurality of inputs/out- 
puts, therefore it becomes difficult for the user to under- 
stand this. 

For this reason, in tiie content preparation software 
tool 4. there is a function referred to as a "Script Export" 
for simplifying the description of ttie script. 

According to the "Script Expert" function, by defin- 
ing the input/output of the script, the template of ttie 
script program can be automatically generated and fur- 
tiier also the input/output field can be edited by using 
tiie "Attribute" window. 

Rgure 37 and Fig. 38 are views of an example of 
tiie interactive operation for preparing the script Figure 
38 shows the interactive operation at tiie time of pop-up. 
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When the user selects "Script/Expert" by the 
mouse 262 in the menu screen of the content prepara- 
tion software tool 4, the template preparation tool 428 
opens the interactive operation for preparing the script 
shewn In Fig. 37 and Rg. 38. 5 

In this interactive operation, "DEF" of the upper- 
most position is used for naming the script node used 
for the routing to the VRML file of the script. The user 
inputs for example "SC1 " to this position as the name of 
the script node. 10 

"ClassName" of the position under "DEP of the 
interactive operation is used for attaching a class name 
to the saipt of the Java language. The user attaches for 
example the temporary name "SC1 " to the script. 

Further, the user defines the Input/output of the is 
script node at the further lower position in the interactive 
operation. In the preparation of the second content, the 
event generated by the sensor (TouchSensor) is input to 
the saipt, therefore the user changes "DataType" on the 
"eventln" side from the sensor (TouchSensor) to 20 
"SFBoor compatible with the format when transferring 
the event from the sensor (TouchSensor) and changes 
lield name" to "inBool". 

The output of the sensor is transferred to the script 
for controlling the color of the material, therefore the 2s 
user changes "DataType" on the "eventOut" side to 
"SFColor" and changes lield name" to "outColor". 

The substance of the display of the interactive oper- 
ation at the point of time when the user ends the set-up 
necessary for the preparation of the script node is as 30 
shown in Fig. 37. 

Further, when the user depresses the "OK" button 
at the bottom portion in the interactive operation shown 
in Fig. 37 by tiie mouse 262. the template preparation 
tool 428 prepares the script node and prepares the tern- 35 
plate of the script corresponding to the script node. 

S415: Description of Debuo Code 

The content preparation software tool 4 further has 40 
a function of supporting and executing the description of 
the script by the Java language. That is, the template 
preparation tool 428 prepares the template of the pro- 
gram corresponding to the script node, outputs the 
same to the text editor 426, and supports the descrip- 45 
tion of the script by the user. When using the content 
preparation software tool 4, the user can prepare tiie 
script by just editing and making modifications to the 
template prepared by the template preparation tool 428 
by using the text editor 426, therefore the trouble so 
required for the preparation of source program of the 
script may be made very small. 

Furtiier, the user can use the Java compiler 474 to 
compile tiie script program prepared by the template 
preparation tool 428 and tiie text editor 426. Accord- ss 
ingiy, the trouble of stopping the content preparation 
software tool 4 and activating the compiler for the Java 
language whenever the source program of the script is 
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prepared becomes unnecessary 

By the work up to this point of time, the newly 
defined template of tiie script is prepared and tiie edit- 
ing of the script becomes possible. However, the tem- 
plate prepared by the template preparation tool 428 is 
only defined by the basic part of the input/output at tiiis 
point of time and does not contain a program for actually 
realizing tiie event. Further, it is also possible for tiie 
user to edit the template by using the text editor 426 by 
the script desaiption support and execution function to 
immediately prepare the script for modifying the color of 
the object, but it is desirable to confirm whetiier or not 
the prepared template actually operates by tiie debug 
code before this. 

Rgure 39 is a view of the screen of the editor dis- 
played by the text editor 426. 

In accordance with the operation of the user, tiie 
text editor 426 displays the template prepared by the 
template preparation tool 428 in the window for text edit- 
ing of tiie display device 24 shown in Fig. 39. 

As shown In Fig. 39, the field name on tiie output 
side defined in tiie work heretofore is defined as tiie pri- 
vate variable (part of private SFColor m_outColor). In 
the initiallzeO method, tiie code for initializing this varia- 
ble is embedded. A method such as JnBoolCBQ is 
called up when tiiere is an Input event. A program oper- 
ated by the Input from the sensor (TouchSensor) is 
described in this method UnBoolCBQ]. 

For example, when the code for viewing the value of 
the input from the sensor Is added to tiie template, the 
following detxjg code is added to the JnBoolCBQ 
metiiod. 



System.out.println("JnBoolCBO called: 
''+ev.getValueO); 

When tills debug code is added and the user clicks 
on the right button and selects "Compile" from ttie pop- 
up menu, tiie Java compiler 474 Is activated, the tem- 
plates (source programs of scripts) to which the debug 
code was added are compiled, and tiie message in the 
compilation Is displayed at the lower part of tiie editor. 

Note that, when the user depresses tiie "Play" but- 
ton for confirmation of operation, the Java compiler 474 
automatically compiles the source programs of the pre- 
pared script to prepare tiie object program, and the 
browser emulator 460 executes tiie automatically pre- 
pared object program. Note, in this case, if an error Is 
generated during the compilation, the browser emulator 
460 does not execute the VRML content. 

When the compilation normally ends, the Java com- 
piler 474 displays the word "Finished" on the screen of 
the editor. When tiie compilation abnormally ends, a 
compilation error is displayed. When a compilation error 
is displayed, tiie user uses the text editor 426 to confirm 
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again whether or not there is a typing error and amend 
the program (template), then executes the compilation 
again, whereby the en'or can be eliminated. 

At the time of the debugging by the Java debugger 
472, the data indicated by the debug code Is displayed 
in the "Route" window, therefore, in this case, the user 
can understand the value of the data input from the sen- 
sor at the time of execution of the script. 

Figure 40 is a view of an example of the script 
"Attribute" window able to be used for the editing of the 
"eventin" and "eventOut" of the script node. Note that, 
for the editing of "eventln" and "evaitOut of the script 
node, the "Script Attribute" window shown In Fig. 40 is 
used. 

When "eventin" or "everrtOut of the "Attribute" win- 
dow of the menu screen Is depressed In a state where 
the user selects the saipt node, the "Script Attribute" 
window shown in Fig. 40 opens. 

When the "format" and "name" are set In the input 
field of the "Script Attribute" window and the "Add" but- 
ton is depressed by the mouse 262. the text editor 426 
adds a field to the script and further modifies the script 
node in the scene graph data base 44. 

Further, when the user displays the Input/output 
attribute of the script in a table in the "Script Attribute" 
window, designates a field, and depresses the "Delete" 
button by the mouse 262, the text editor 426 erases the 
description of the field from the script. 

Further, when modifying the "format" and "name" of 
the field of the script, the field of the script is erased 
once, then they are newly added. 

When the script node is modified by the above 
operation, the text editor 426 automatically modifies the 
source program of the script so as to be compatible with 
the state after modification. 

A concrete example of the automatic modification 
of a source program will be given next. 

For example, when the user displays the "eventOut" 
side in the "Script Attribute" window shown In Fig. 40, 
designates the TypeName" side as "SFBool", desig- 
nates the "EventName" side as "outColor", and 
depresses the "Delete" button, the text editor 426 auto- 
matically erases the 10th row of the script shown In Fig. 
39 (private SFColor m_outColor;) to reflect the modifi- 
cation. 

S416: Setting of Route to Script Node 

Figure 41 is a view of an example of the content of 
the "Route" window. 

As mentioned above, in order to make the script 
operate, routing is necessary In the second script. In 
the "Route" window shown In Fig. 41, the event gener- 
ated by the sensor (TouchSensor) is routed to the script 
node, and the color of the object (cone) Is modified. 

Figure 42 is a view of the substance of the "Java 
Console" window displayed by the browser emulator 
460. 



When the cursor of the mouse 262 passes through 
the object (cone). If the routing is performed making the 
event generated by the sensor (TouchSensor) "isOver" 
and the field of the script node receiving the event 
5 "inBool" designated by using the "Script Expert" func- 
tion, the Java debugger 472 displays for example a 
message of the content shown in Fig. 43 in the "Java 
Console" window. 

10 S417: Confirmation of Operation 

In the work of describing the debug code of step 
415 (S415), the debug code is added to the script, 
tiierefbre when the message shown in Rg. 43 is dis- 

15 played in the "Java Console" window, the user can con- 
firm whether or not the saipt operates without error. 
Further, In order to confirm the operation of the second 
content, the user may depress the "Play" button of the 
display device 24 in the same way as at the time of con- 

20 f irmation of operation of the first content. 

Further, when there is a necessity for displaying the 
value of the output of the script, when the user selects 
tiie "View/Java Console" menu of the menu screen, the 
browser emulator 460 displays tiie "Java Console" wln- 

25 dow shown in Fig. 43. 

Further, when the user depresses the "Play" button 
of the menu of the display device 24, the browser emu- 
lator 460 emulates the operation of the VRML browser 
308 and displays the object (image) of the three-dimen- 

30 sional virtual space indicated by the VRML content in 
tiie "3D View" window. Further, when tiie user nrraves 
the cursor In the "3D View" window to the object by the 
mouse 262, as shown in Fig. 41 , the Java debugger 472 
displays the message "true" in tiie "Java Console" wln- 

35 dow, while when tiie user moves the cursor away from 
tiie object, the message "false" Is displayed. 

TTie substance of the display of tiie "Java Console" 
window shown in Fig. 43 shows that, when tiie cursor of 
tiie mouse 262 comes to the object, the sensor (Touch- 

40 Sensor) attached to the object detects this state and 
generates an event, this is transmitted to the script 
node, and tiie script node receives the event. The dis- 
play in tiie "Java Console" window Is carried out by the 
execution of system.out.prlntlnO in tiie method. 

45 Note that, even in a case when the cursor of the 
mouse 262 is moved away from the object, the event is 
similarly transmitted and the result of the operation is 
displayed In the "Java Console" window. 

When the user debugs the script, as mentioned 

50 above, It can confirmed whether or not the event is 
being normally transmitted to the script by adding the 
debug code to the script. 
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S418: Description of Prooram Correspondino to Script 

Figure 44 is a view of an example of the saipt 
obtained by adding codes for changing the color of tiie 
object (cone). 
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Hie color of the object is modified by writing a value 
in the field of the output side of the script shown in Fig. 
44 (variable name •'m_outColor") and routing to the 
material attribute. In order to add codes for changing the 
color of the object to the script, the following codes are 
added to the method UnBoolCBQ]. 



float rn = (1.0f. O.Of, O.Of); 

float gD = (O.Ot 1.0f, O.Of); 

if (evgetValueO) m_outColor.setValue (r); 

else m_outColorselValue(g); 



By the addition of these codes, in the emulation 
operation by the browser emulator 460, when the cursor 
of the mouse 262 enters the object, ev.getValueQ of the 
code becomes "true" and red is output from the scriprt 
{SC1), while when the cursor leaves it, ev.getValueQ of 
the code becomes lalse" and green is output from the 
script. 

S419: Settino of Route to Material Node 

In order to actually change the color of the object 
(cone), it Is necessary to perform routing from the script 
node to the material attribute. 

Figure 36 is a view of the substance of the display 
of the case when "outColor" of the saipt program (SCI) 
Is routed to "diffuseColor** of the material attribute 
(C0NE1_MAT) In the "Route" window. 

When the user routes "outCJolor" of the script node 
(SC1) to "diffuseColor" of C0NE1_MAT In the "Route" 
window, the flow of the event of the propagation of the 
event from the sensor (TouchSensor) to the script (SCI) 
together with the routing set heretofore and further the 
propagation of the event from the script node to the 
material attribute (C0NE1_MAT) is completed. 

When the above work is ended, if the user 
depresses the "Play" button of the "Conductor" window 
and moves the cursor of the rrrouse 262 onto the object 
(cone), the color of the object becomes red, while when 
it moves the cursor away from the object, the color of the 
object becomes green. 

In the same way as when confirming the operation 
of the first content, the backup manager 466 holds the 
Initial state of the content and the viewpoint of the user 
at the start of the confirmation of the operation. When 
the user depresses the "Stop" button and the operation 
of the browser emulator 460 is ended, the model editing 
tool 420 restores and displays the content of the initial 
state held In the backup manager 466 In the "3D View" 
window In a state when it is seen from the viewpoint of 
the user at the start of the confirmation of the operation. 

For example, when the substance of the display of 
the initial state of the VRML content at the start of the 



confirmation of the operation is as shown in Fig. 28 and 
the substance of the display of the content at the end of 
the confirmation of operation Is as shown In Fig. 31 , the 
model editing tool 420 returns the display of the object 

5 (cone) in the "3D View" window to the content shown In 
Fig. 28 based on the initial state held by the backup 
manager 466. 

The operation of the content in the confirmation of 
operation explained here is as follows. 

10 When the cursor moves to the object, the sensor 
(TouchSensor) attached to the object detects this and 
the event Is generated. The generated event is transmit- 
ted to the script node by the setting of the routing, and 
the script node executes the method During the 

15 method, when receiving the input event (true), red is set 
in the output field, the color written in the output field is 
set for the material attribute of the object (cone) by the 
routing, and the color of the object (cone) In the three- 
dimensional virtual space becomes red. Similarly, when 

20 the cursor is moved away from the object (cone), the 
event (false) is transmitted from the sensor (TouchSen- 
sor) to the script node, and the method sets green In the 
field of output and changes the object (cone) to the 
green color. 

25 

Clickinc of Obiect (Cone) to Make Sound 

An explanation will now be made of the case of pre- 
paring a VRML content (third content) of producing a 
30 sound when clicking on the object (cone) by the mouse 
262 as a third specific example of preparation of the 
content of three-dimensional virtual space (VRML con- 
tent) using the content preparation software tool 4. 
Below, an explanation will be made of the work for 
35 preparation of the third content. 

In VRML 2.0, It is possible to use a sound node to 
output a sound. The content preparation software tool 4 
has the function of dragging and dropping a sound node 
from the sound library to add the sound node to the 
40 world. 

The work for preparing the third content is candied 
out by the following process Illustrated in Rg. 45: 

S431: Preparing the graphic data of the object 
45 (cone) [an'anging the geometry node (cone)] 

S432: Adding a sensor [ananging a sensor node 
(TouchSensor)] 

S433: Arranging a sound node 
S434: Confirming the operation 
50 S435: Setting and routing the AudioClip node 
S436: Confirming tiie operation 

The operation of step 431 and step 432 is the same 
as with preparation of the first content and preparation 
55 of the second content, so the explanation will be omit- 
ted. Here, a name "TSr Is attached to the sensor 
(TouchSensor). Next, the operation of the default of the 
sound node Is confirmed, tiie modification of the 
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45 

attribute and routing are can-ied out. and the sound is 
confirmed by clicking on the object. 

S433: Arrangement of Sound Node 

Figure 46 is a view of the "Scene Graph" window 
and the "Attribute" window when arranging the sound 
node. 

In VRML, to output a sound, it is necessary to 
arrange a sound node. The content preparation soft- 
ware toot 4 is constituted so as to add a sound node by 
the user clicking on the first "Sound" tab of the 
"Resource Library" window shown in Fig. 9 by the 
mouse 262 to open the sound library and dropping a 
sound node from the sound library. 

First, the user views the "3D View" window and con- 
firms that nothing has been selected. When a certain 
object is selected, the user selects "Unselect" by the 
pop-up menu of the "Scene Graph" window shown in 
Fig. 46 to instruct the release of the selection to the 
model editing tool 420. 

Further, the user confirms that the object (cone) is 
visible in the "3D View" window. When it selects "Clas- 
sic" from the sound library of the "ResourceLibrary" win- 
dow and drops this into the "3D View" window, the 
model editing tool 420 adds the sound node to the 
graphic data of the object. 

When the user clicks on the tree displayed in the 
"Scene Graph" window, the scene graph editing tool 
424 displays the content shown in Fig. 47 and indicates 
to the user that the sound node has been added. 

In the sound node, it is possible to designate the 
region of the sound by a "maxBack", "maxFront", or 
other field. Note that. In the default state when dropped 
from the library, "maxBack" = "maxFront" = 10 is set so 
that the sound is output when the cursor of the mouse 
262 enters the region. 

S434: Confirmation of Operation 

The user can confirm the sound node by depress- 
ing the "Play" button. In the content preparation soft- 
ware tool 4, the cursor of the mouse 262 is set to 
already enter the region of the sound immediately after 
the sound node is dropped, therefore when the user 
depresses the "Play" button, the set sound (classic 
music in this example) is output. 

Further, in the content preparation software tool 4, 
the "spatialize" field of the sound node is set to "TRUE" 
in the default state. When moving (navigating) in the 
three-dimensional virtual space by using the mouse 262 
in the "3D View" window, the magnitude of the sound 
and the left and right pans change in accordance with 
the position of the cursor of the mouse 262. 

Next, when the user depresses the "Stop" txjtton of 
the display device 24 to return to the preparation mode 
and selects "Sound" in the "Scene Graph" window, the 
model editing tool 420 displays a blinking bounding box 
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showing the region where the sensor (TouchSensor) 
generates the event oulputting the sound around the 
object (cone) shown in the "3D View" window on the left 
side and the "ParallelView" window on the right side as 

5 shown in Fig. 47, so the user can visually confirm the 
region of the sound. 

Further, when the user selects "Parallel View/Tip 
View" from the pop-up menu of the "3D View" window, 
the model editing tool 420 three-dimensionally displays 

10 the image of the object (cone) from the front surface in 
the "3D View" window on the left side of Fig. 47 and two- 
dimensionally displays the image of the object (cone) 
seen from above in the "ParallelView" window on the 
right side. 

15 When the user moves the viewpoint so as to see 
the whole object and bounding box in the "ParallelView" 
window shown in Fig. 48, if it depresses the shift key of 
the keyboard 260 and the left button of the mouse 262 
(not illustrated) and drags the "ParallelView" window in 

20 the downward direction, the model editing tool 420 dis- 
plays the image of the object from a far away viewpoint 
in the "ParallelView" window. 

When the user pushes the "Play" button and then 
moves the cursor of the mouse 262 in the "3D View" 

25 window, a sound is output when the cursor enters the 
region indicated by the bounding box shown in Fig. 46. 
The output of the sound is stopped when the cursor 
leaves this region. 

Figure 48 is a view of an example of modification of 

30 the size of the region for outputting the sound shown in 
Fig. 47. 

In the content preparation software tool 4. it is pos- 
sitAe to numerically designate the region indicated by 
the bounding box in the "Attribute" window or switching 
35 the mouse mode on the menu screen shown in Fig. 9, 
as shown in Fig. 47, so as to move, rotate, and scale 
this region by using the mouse. 

S435: Setting and Routing of AudioClip Node 

40 

When adding the sound node by the above worK 
the sound is automatically output when the cursor of the 
mouse 262 enters into the region of sound indicated by 
the bounding box in Fig. 34 and Fig. 35. This is related 
45 to the setting of "startTime" == 0."stopTime" = 0. and 
"loop: = "TRUE" of the AudioClip node attached to ttie 
sound node. 

In VRML 2.0, "startTime" of the AudioClip node rep- 
resents the start time and outputs sound in the case of 
50 "StartTime" >= "stopTime". Further, it is also possible to 
repeatedly output the sound by setting "loop" = "TRUE". 
Further, in Fig. 47 and Fig. 48, when modification is 
made so as not to give off a sound until the region indi- 
cated by the bounding box is clicked by the mouse 262, 
55 "StartTime" = -1 is set. Further, in order to stop the out- 
put of the sound when the region indicated by the 
bounding box is clicked, the clicked time is assigned for 
"StartTime". 
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Figure 49 is a view of an example of the modtfica- 
tion of AudioClip node and the routing from the sensor 
(TouchSensor) to the AudioClip node. 

For example, in order to set the stopping of the out- 
put of the sound when the region defined by the bound- 5 
ing box is clicked, as shown in Fig. 48. the user must 
select the first "AudioClip" tab of the "ResourceLibrar/* 
window, attach a name "ACr to the AudioClip node, 
and further perform the routing from "touchTime" of the 
sensor (TouchSensor ;TS1) to "startTime" of the Audio- io 
Clip node in the "Route" window. 

S436: Confirmatipn of Operation 

When the user depresses the "Play" button by the is 
mouse 262 and clicks the object (cone) displayed in the 
"3D View" window, the output of the sound is started by 
the browser emulator 460. 

The operation of the third content is as follows. 

When the user clicks on the object (cone) in the "3D 20 
View" window by the mouse 262. the event "touchTime" 
is generated from the sensor (TouchSensor) attached to 
the object. In this event, the clicked time (in VRML 2.0, 
the relative time from 00:00:00 GMT January 1 , 1 970) is 
transferred to "startTime" of AudioClip. "startTime" is 25 
set and the output of the sound is commenced. Note 
that, in this example, the loop field of the AudioClip node 
is set to "TRUE", therefore the sound (music) is repeat- 
edly reproduced and output. 

With this setup, the output of the sound cannot be 30 
stopped unless the cursor is moved to the outside of the 
region of the sound, therefore when stopping the output 
of the sound, the user must use the text editor 426 etc. 
to modify the program so as to stop the output of the 
sound under predetermined conditions. 35 

Note that, in the embodiment, the explanation was 
given by taking as an example the case of preparing the 
graphic data of a conical object, attaching a touch sen- 
sor to the graphic data, and modifying the common 
node (light) or color or outputting a sound, but the con- 40 
tent preparation software tool 4 of the present embodi- 
ment is not limited to this. Needless to say the VRML 
content can be prepared by using all nodes supported 
by VRML 2.0. 

Further, the content preparation software tool 4 can 45 
handle languages for describing threenjimensionat vir- 
tual space other than VRML by suitable modification. 

Effect of the Invention 

50 

As explained above, it is possible to view an object 
displayed in a window of a display device from the 
desired viewpoint by designating "Navigate", "Move", 
"Rotate", or "Scale" operations provided in a "Conduc- 
tor" window of a screen of the display device. As a 55 
result, it is possible to check the state of an object while 
preparing a Conductor even in the stage of preparing 
the same. 



Further, the method of viewing an object from differ- 
ent viewpoints of the present invention is superior in 
interactive operation. 

Further, according to the present invention, the fol- 
lowing effects are obtained. 

According to the graphic data generating appara- 
tus, graphic data generation method, and medium of the 
same of the present invention, it is possible to compre- 
hensively perform work such as the preparation of 
graphic data showing the shape of a graphic of an 
object in virtual space, the position in a three<limen- 
sional space, etc., programming an event (saipt) in the 
virtual space, and establishing correspondence 
between the pointing to an object and the activation of a 
script (routing). 

Further, according to the graphic data generating 
apparatus, graphic data generation method, and 
medium of the same of the present invention, the 
model, script, routing, and other result of work can be 
immediately confirmed. 

Further, according to the graphic data generating 
apparatus, graphic data generation method, and 
medium of the same of the present invention, the prep- 
aration of software enabling operations in the three- 
dimensional virtual space to be performed by an inter- 
active manner is made easy. 

Further, according to the graphic data generating 
apparatus, graphic data generation method, and 
medium of the same of the present invention, the shape 
of a three-dimensional object displayed in the virtual 
space can be correctly grasped by a two-dimensional 
screen display. 

Further, according to the graphic data generating 
apparatus, graphic data generation method, and 
medium of the same of the present invention, it is possi- 
ble to visually easily set the range of the valid region of 
a sensor generating an event in accordance with an 
operation with respect to the object and to confirm the 
valid region of the set sensor and it is easy to confirm 
the operation of the event generated in accordance with 
on operation with respect to the sensor. 

INDUSTRIAL APPLICABILITY 

The graphic data generating apparatus, graphic 
data generation method, and medium of same of the 
present invention can be used widely as authoring tools 
for content in a three-dimensional graphic description 
language expressing an object in a three-dimensional 
virtual space. 

LISTQF REF^p^NCES 

1... network system 

10... in house network 

100... hard disk drive 
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102... server device 

12... Internet system 
14... Internet provider 
16... ISDN net 

2... client (subscriber) system 

20... computer 
24... display device 
26... input device 

260... keyboard 
262... mouse 

28... recording medium 

280... floppy disk 
282... MO disk 

4... content preparation software tool 

40... graphical user interface unit (GUI) 
42... editing tool 

420... model editing tool 
422... routing editing tool 
424... scene graph editing tool 
426... text editor 

44... scene graph data base 
46... working tool 

460... browser emulator 
462... file input/output unit 
464... file scope management unit 
466... backup manager 
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means in the second window; 
the editing processing means selecting an 
object corresponding to a node selected by the 
selecting means, operating linked with the 
selecting means to display this in the second 
window, and successively moving tie object 
corresponding to the selected node to prede- 
termined positions of the second window. 

A graphic data generating apparatus as set forth in 
claim 1. wherein the editing processing means and 
the display processing means enlarge to a certain 
size and display the graphic of the object corre- 
sponding to the node at tiie center of the second 
window. 

A graphic data generating apparatus as set fortii in 
claim 1, wherein the selecting means includes a 
mouse operating linked with the display device. 

A graphic data generating apparatus as set forth in 
any one of claims 1 to 3. further comprising: 

an operation instructing means for giving 
instructions (Rotate, Move, Navigate, Scale) so 
that an object displayed in the second window 
of the display device can be viewed from differ- 
ent viewpoints and 

wherein after the graphic of the selected object 
is shown nrroved to a predetermined position of 
the second window, the editing processing 
means and the display processing means dis- 
play the object displayed in virtual space in the 
second window of the display device from a dif- 
ferent viewpoint in accordance with an opera- 
tion instruction from tiie operating instructing 
means. 



47... script preparation unit 

470... Java emulator 
472... Java debugger 
474... Java conrpiler 

Claims 

1 . A graphic data generating apparatus comprising: 

a display processing means (31, 40) for dis- 
playing information in a first window and sec- 
ond window of a screen of a display device 
(24); 

a selecting means (262) for selecting a node 
displayed in the first window of the display 
device; and 

an editing processing means (420) for process- 
ing to display a graphic of an object corre- 
sponding to a node selected by the selecting 
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5. A graphic data generating apparatus as set forth in 
claim 4, wherein the operation instructing means 
includes an operating means for making the object 
rotate, an operating means for making the object 
move, and a means for changing tiie size of the 
object. 

6. A graphic data generating apparatus as set forth in 
claim 5, wherein the means for changing the size of 
the object has a means for enlarging the size of the 
object and/or a means for reducing tiie size of the 
object. 

7. A graphic data generating apparatus as set forth in 
any one of claims 4 to 6, wherein tiie operation 
instructing means has a Rotate means, Move 
means. Navigate means, and Scale means dis- 
played on the screen of the display device. 

8. A graphic data generating method including the 



26 



51 



EP0 890 926A1 



52 



steps of: 

displaying selectable nodes in a first window of 
a display device (24), 

attaching a node selected by a selecting 5 
means (262) for selecting a predetermined 
node from nodes displayed in the first window, 
and 

moving display for displaying an object corre- 
sponding to a received selected node in a sec- io 
ond window and successively moving it to 
predetermined positions in the second window. 

9. A graphic data generating method as set forth in 
claim 8. wherein, in the moving display step, a is 
graphic of the object corresponding to the node is 
displayed at the center of the second window 
enlarged to a predetermined size. 

10. A graphic data generating method as set forth in 20 
claim 8, wherein the selecting means (262) 
includes a mouse operating linked with the display 
device. 

11. A graphic data generating method as set forth in 25 
any one of claims 8 to 1 0, which, after moving the 
graphic of the selected object to a redetermined 
position in the second window for the display, ena- 
bles viewing of the object displayed in virtual space 

in the second window of the display device from a 30 
different viewpoint in accordance with an instruction 
(Rotate, Move, Navigate, Scale) of an operation 
instructing means so that the object displayed in the 
second window of the display device can be viewed 
from different viewpoints. 35 

12. A graphic data generating method as set forth in 
claim 1 1 . wherein the operation instruction includes 
an instruction for making the object rotate, an 
Instruction for making the object move, and an 40 
instruction for changing the size of the object. 

13. A graphic data generating method as set forth in 
claim 12, wherein the instruction for changing the 
size of the object includes an instruction for enlarg- 45 
ing the size of the object or an instruction for reduc- 
ing the size of the object. 

14. A medium for mediating & program executing the 
graphic data generating method including the steps so 
of: 



moving display step of displaying an object cor- 
responding to a received selected node in a 
second window and successively moving it to 
predetermined positions in the second window. 

15. A medium for mediating a program for executing a 
graphic data generating method as set forth in 
claim 14, wherein, in the moving display step, a 
graphic of the object con^esponding to the node is 
displayed at the center of the second window 
enlarged to a predetermined size. 

16. A medium for mediating a program for executing a 
graphic data generating method as set forth in 
claim 15, wherein after moving the graphic of the 
selected object to a predetermined position in the 
second window for the display, the program enables 
viewing of the object displayed in virtual space in 
the second window of the display device from a dif- 
ferent viewpoint in accordance with an instruction 
(Rotate, Move, Navigate. Scale) of an operation 
instructing means so that the object displayed in the 
second window of the display device can be viewed 
from different viewpoints. 

17. A medium for mediating a program for executing a 
graphic data generating method as set forth in 
claim 16. wherein the operation instruction includes 
an instruction for making the object rotate, an 
instruction for making the object move, and an 
instruction for changing the size of the object. 

18. A medium for mediating a program for executing a 
graphic data generating method as set forth in 
claim 17, wherein the instruction for changing the 
size of the object includes an instruction for enlarg- 
ing the size of the object or an instruction for reduc- 
ing tiie size of the object. 



displaying selectable nodes in a first window of 
a display device (24), 

attaching a node selected by a selecting 55 
means (262) for selecting a predetermined 
node from nodes displayed in the first window, 
and 
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